00000001:02000400:0.0F:1788619663.084852:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788619684.102311:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788619685.436556:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1051 MB/s 00000001:01000000:2.0:1788619685.685889:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1359 MB/s 00000001:01000000:3.0F:1788619685.937495:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5051 MB/s 00000020:02000000:0.0:1788619686.846184:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g10061d6 00000400:02000000:3.0:1788619687.855907:0:3293:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:2.0:1788619691.815873:0:3442:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788619753.785233:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1788619764.038455:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788619764.038464:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788619764.038615:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006a958aaf 00000080:02000400:1.0:1788619764.038625:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788619764.048812:0:5821:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788619764.048824:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788619764.048863:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bf5ace95) 00000020:00000080:1.0:1788619764.048882:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788619764.094910:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788619764.096522:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788619764.135595:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788619764.135637:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788619764.135657:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788619764.136640:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788619764.136699:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788619764.137120:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788619764.137129:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788619764.137139:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbdd80 00000020:01000004:2.0:1788619764.137147:0:5821:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788619764.137151:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788619764.137155:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006a958aaf from MGS 00000020:01000004:2.0:1788619764.137159:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788619764.138839:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004314f699) 00000020:00000080:2.0:1788619764.138865:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788619764.138994:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006a958aaf from MGS, refs=2 00080000:01000000:2.0:1788619764.139002:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788619764.139008:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbdd8e 00000100:00100000:2.0:1788619764.139131:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788619764.140708:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788619764.140719:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788619764.142090:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788619764.142100:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788619764.143506:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619764.143693:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788619764.143699:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788619764.155671:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788619764.155689:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788619764.161504:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788619764.161515:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788619764.177524:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619764.177530:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619764.177532:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619764.178022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619764.178025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619764.178027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619764.178757:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788619764.185938:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788619764.429648:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2525 MB/s 00000001:01000000:3.0:1788619764.679266:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2743 MB/s 00000001:01000000:2.0:1788619764.929407:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 651 MB/s 00000001:01000000:1.0:1788619765.180123:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 788 MB/s 00010000:00010000:3.0:1788619765.190901:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788619765.203617:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788619765.220370:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788619765.220386:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788619765.220388:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788619765.226411:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788619765.226579:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788619765.226633:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788619765.227227:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788619765.227269:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788619765.227615:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788619765.227848:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788619765.227855:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788619765.228513:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788619765.228520:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788619765.229884:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788619765.229894:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788619765.237416:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788619765.237443:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:2.0:1788619765.237445:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1788619765.238070:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788619765.238103:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:3.0:1788619765.238125:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (0000000008be324a) 00000020:00000080:3.0:1788619765.238143:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788619765.238283:0:5821:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000184c791@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788619765.238453:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:3.0:1788619765.238460:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788619765.239898:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788619765.240289:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 42040134-1c22-4778-8507-c9e1e3983208) 00000020:00000080:3.0:1788619765.240311:0:5821:0:(genops.c:1385:class_connect()) connect: client 42040134-1c22-4778-8507-c9e1e3983208, cookie 0xbb0e330328bbdd9c 00000100:00080000:3.0:1788619765.242173:0:5821:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788619765.242183:0:5821:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import 000000000184c791 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788619765.242228:0:5821:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002aabb7bb x1875503676915840/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788619765.242251:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 42040134-1c22-4778-8507-c9e1e3983208->MGS 00000020:01000004:3.0:1788619765.242273:0:5821:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788619765.242279:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788619765.242291:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008ff68c8a) 00000020:00000080:3.0:1788619765.242306:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788619765.243136:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002aabb7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42040134-1c22-4778-8507-c9e1e3983208:3308:1875503676915840:0@lo:250: 00000100:00100000:2.0:1788619765.243213:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619765.246024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676915840 00000100:00100000:2.0:1788619765.246038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676915840 00000100:00100000:2.0:1788619765.246076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619765.246082:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a400a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1875503676915840:12345-0@lo:250: 00010000:00080000:2.0:1788619765.246108:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 42040134-1c22-4778-8507-c9e1e3983208@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1788619765.246134:0:5833:0:(genops.c:1385:class_connect()) connect: client 42040134-1c22-4778-8507-c9e1e3983208, cookie 0xbb0e330328bbddaa 00000100:00080000:2.0:1788619765.246276:0:5833:0:(import.c:65:import_set_state_nolock()) 000000004124f13a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619765.250090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a400a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+5:3308:x1875503676915840:12345-0@lo:250: Request processed in 3997us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619765.250106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619765.250212:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788619765.250222:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:2.0:1788619765.250230:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788619765.250235:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788619765.250238:0:3308:0:(import.c:65:import_set_state_nolock()) 000000000184c791 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788619765.250241:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788619765.250259:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788619765.250265:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002aabb7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42040134-1c22-4778-8507-c9e1e3983208:3308:1875503676915840:0@lo:250: 00000100:00100000:3.0:1788619765.259454:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788619765.259658:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788619765.259664:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788619765.264022:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788619765.264037:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788619765.266250:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788619765.266273:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788619765.268391:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788619765.269063:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788619765.269070:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788619765.269749:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788619765.269758:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788619765.305716:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619765.306044:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788619765.306053:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788619765.308183:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788619765.308195:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788619765.309117:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619765.309284:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788619765.309290:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788619765.309941:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788619765.309948:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788619765.310934:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619765.311115:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788619765.311127:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788619765.311887:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788619765.311895:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788619765.312430:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619765.312720:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788619765.312726:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788619765.313400:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788619765.313407:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788619765.354592:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619765.354943:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788619765.354950:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788619765.357739:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788619765.357755:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788619765.359712:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788619765.359727:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788619765.366197:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788619765.366293:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788619765.366298:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788619765.366424:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788619765.366601:0:5821:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788619765.366605:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788619765.366607:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788619765.366613:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619765.366614:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788619765.366615:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619765.366616:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619765.366617:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788619765.366618:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788619765.366619:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788619765.366620:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788619765.366621:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619765.366622:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788619765.366624:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788619765.366626:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788619765.366627:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788619765.366628:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619765.366628:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788619765.366629:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619765.366630:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619765.366631:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788619765.366631:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788619765.366632:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788619765.366633:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788619765.366633:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619765.366634:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788619765.366670:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788619765.366686:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068d9f6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676915968:0@lo:253: 00000100:00100000:2.0:1788619765.366765:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619765.367100:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c0212545 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.367642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676915968 00000100:00100000:3.0:1788619765.367650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676915968 00000100:00100000:3.0:1788619765.367745:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788619765.367755:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc9e7d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+5:5821:x1875503676915968:12345-0@lo:253: 20000000:01000000:3.0:1788619765.367990:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788619765.367993:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788619765.368406:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788619765.368476:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788619765.371044:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788619765.373722:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788619765.376726:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788619765.376735:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788619765.376742:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788619765.376744:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788619765.376765:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788619765.377164:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788619765.377615:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788619765.377631:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788619765.377688:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788619765.377734:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788619765.377973:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788619765.378080:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788619765.378089:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788619765.378251:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788619765.378261:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788619765.378294:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788619765.378301:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788619765.378329:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788619765.378375:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788619765.378411:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788619765.378416:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788619765.378430:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788619765.378678:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788619765.378688:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788619765.378722:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788619765.378755:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788619765.379064:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788619765.379078:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788619765.379168:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788619765.379177:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788619765.379221:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788619765.379259:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788619765.379294:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788619765.379306:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788619765.379414:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788619765.379424:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788619765.379723:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788619765.379763:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788619765.380101:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788619765.380373:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788619765.380381:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788619765.381056:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788619765.381580:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788619765.381619:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:2.0:1788619765.381622:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788619765.381662:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788619765.381671:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788619765.381702:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788619765.381710:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788619765.381759:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788619765.382000:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788619765.382044:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788619765.382086:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788619765.382319:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788619765.382323:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788619765.382327:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788619765.382339:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788619765.382342:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788619765.382372:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788619765.382374:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788619765.383060:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788619765.383607:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788619765.383654:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788619765.383724:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788619765.383737:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788619765.383739:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788619765.384666:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788619765.385304:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788619765.385356:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788619765.385393:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788619765.385407:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788619765.385409:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788619765.385414:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788619765.385417:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788619765.385422:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788619765.385428:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788619765.386634:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788619765.386902:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788619765.401470:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788619765.401525:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788619765.401615:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788619765.401638:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788619765.401660:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401676:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401686:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401691:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401697:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401719:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401726:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a8002fa already unused, calling callback (00000000f3e76063) 00010000:00010000:1.0:1788619765.401729:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401736:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401755:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401764:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.401797:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a8002fa/0xbb0e330328bbddb1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788619765.402623:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788619765.638597:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc9e7d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+5:5821:x1875503676915968:12345-0@lo:253: Request processed in 270838us (271825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619765.638612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619765.638722:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068d9f6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676915968:0@lo:253: 10000000:01000000:2.0:1788619765.638737:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788619765.638740:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788619765.638741:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788619765.638742:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619765.638743:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788619765.638745:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619765.638746:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619765.638747:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788619765.638748:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788619765.638749:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788619765.638750:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619765.638751:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788619765.638769:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006a958aaf from lustre-MDT0000 10000000:01000000:2.0:1788619765.638813:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788619765.638816:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788619765.638819:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9333871319c0 10000000:01000000:2.0:1788619765.638823:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788619765.638830:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9333871319c0 from 1 10000000:01000000:2.0:1788619765.638833:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788619765.638867:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619765.638877:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619765.638886:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619765.638903:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068d9f6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916096:0@lo:101: 00000100:00100000:2.0:1788619765.638938:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619765.639005:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc525706 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.639099:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916096 00000100:00100000:3.0:1788619765.639106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916096 00000100:00100000:3.0:1788619765.639148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788619765.639156:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5938452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+5:5821:x1875503676916096:12345-0@lo:101: 00010000:00010000:3.0:1788619765.639167:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619765.639180:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbddb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.639200:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.639209:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.639229:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8096f5b, rc 0) 00000100:00100000:3.0:1788619765.639401:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5938452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+6:5821:x1875503676916096:12345-0@lo:101: Request processed in 245us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619765.639407:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619765.639595:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068d9f6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916096:0@lo:101: 00010000:00010000:1.0:1788619765.639609:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.639617:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619765.639678:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916224:0@lo:501: 00000100:00100000:1.0:1788619765.639720:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619765.639822:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a7f6279 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.639917:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916224 00000100:00100000:3.0:1788619765.639922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916224 00000100:00100000:2.0:1788619765.640071:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788619765.640079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000943b7030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+6:5821:x1875503676916224:12345-0@lo:501: 00000100:00100000:2.0:1788619765.640340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000943b7030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+6:5821:x1875503676916224:12345-0@lo:501: Request processed in 262us (620us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788619765.640348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619765.640710:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916224:0@lo:501: 10000000:01000000:1.0:1788619765.640737:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788619765.640757:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.640765:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619765.640794:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93338a7b5000 10000000:01000000:1.0:1788619765.640799:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788619765.640803:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93338a7b5000 10000000:01000000:1.0:1788619765.640806:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788619765.640808:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93338a7b5000 from 1 10000000:01000000:1.0:1788619765.640811:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788619765.640835:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.640842:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.640849:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619765.640862:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916352:0@lo:101: 00000100:00100000:1.0:1788619765.640893:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619765.641086:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a7f6279 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.641236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916352 00000100:00100000:3.0:1788619765.641242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916352 00000100:00100000:3.0:1788619765.641268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788619765.641274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c9e834d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+6:5821:x1875503676916352:12345-0@lo:101: 00010000:00010000:3.0:1788619765.641283:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619765.641295:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005350ad5b/0xbb0e330328bbddcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbddc6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641312:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005350ad5b/0xbb0e330328bbddcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbddc6 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641321:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005350ad5b/0xbb0e330328bbddcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbddc6 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641328:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005350ad5b, rc 0) 00000100:00100000:3.0:1788619765.641369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c9e834d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+7:5821:x1875503676916352:12345-0@lo:101: Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619765.641374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788619765.641509:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916352:0@lo:101: 00010000:00010000:1.0:1788619765.641519:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.641547:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619765.641561:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788619765.641575:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.641581:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000004a8002fa/0xbb0e330328bbddc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619765.641587:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788619765.641590:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788619765.641594:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93338a7b5000 10000000:01000000:1.0:1788619765.641596:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788619765.641598:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788619765.641600:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788619765.641614:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.641619:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.641626:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619765.641636:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916480:0@lo:101: 00000100:00100000:1.0:1788619765.641660:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619765.641672:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a7f6279 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.641736:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916480 00000100:00100000:3.0:1788619765.641740:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916480 00000100:00100000:3.0:1788619765.641757:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788619765.641762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083393b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+7:5821:x1875503676916480:12345-0@lo:101: 00010000:00010000:3.0:1788619765.641804:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619765.641813:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbddd4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641826:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641833:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619765.641839:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b472a650, rc 0) 00000100:00100000:3.0:1788619765.641864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083393b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+8:5821:x1875503676916480:12345-0@lo:101: Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619765.641870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788619765.641937:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916480:0@lo:101: 00010000:00010000:1.0:1788619765.641946:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619765.641953:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619765.641994:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916608:0@lo:501: 00000100:00100000:1.0:1788619765.642016:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619765.642041:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a7f6279 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.642147:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916608 00000100:00100000:3.0:1788619765.642151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916608 00000100:00100000:3.0:1788619765.642171:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788619765.642175:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb671153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+8:5821:x1875503676916608:12345-0@lo:501: 00000100:00100000:3.0:1788619765.642373:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb671153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:5821:x1875503676916608:12345-0@lo:501: Request processed in 197us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619765.642380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788619765.642524:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916608:0@lo:501: 00000100:00100000:1.0:1788619765.642560:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916736:0@lo:503: 00000100:00100000:1.0:1788619765.642596:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619765.642692:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a7f6279 going to sleep for 11 seconds 00000100:00100000:2.0:1788619765.642766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916736 00000100:00100000:2.0:1788619765.642850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916736 00000100:00100000:2.0:1788619765.642882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788619765.642888:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f5cac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+9:5821:x1875503676916736:12345-0@lo:503: 00000100:00100000:2.0:1788619765.643179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f5cac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+9:5821:x1875503676916736:12345-0@lo:503: Request processed in 290us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619765.643186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619765.643291:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676916736:0@lo:503: 00000100:00100000:2.0:1788619765.643693:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cb8d4a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5865:1875503676916864:0@lo:502: 00000100:00100000:2.0:1788619765.643728:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619765.643809:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000288baa34 going to sleep for 11 seconds 00000100:00100000:3.0:1788619765.643896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916864 00000100:00100000:3.0:1788619765.643901:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916864 00000100:00100000:2.0:1788619765.644038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788619765.644046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a34ac016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:5865:x1875503676916864:12345-0@lo:502: 00000100:00100000:2.0:1788619765.644283:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a34ac016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:5865:x1875503676916864:12345-0@lo:502: Request processed in 238us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619765.644291:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788619765.644362:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cb8d4a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5865:1875503676916864:0@lo:502: 00000020:01000000:3.0:1788619765.644389:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619765.644400:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619765.644402:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788619765.644408:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788619765.644410:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788619765.644429:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000058e346b2) 00000020:00000080:3.0:1788619765.644457:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788619765.644464:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788619765.644528:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788619765.644545:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbdde9 00000020:00000080:3.0:1788619765.644748:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788619765.644753:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619765.644756:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619765.644757:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788619765.644759:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619765.644763:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619765.644764:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788619765.644767:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788619765.644794:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000053ddf39d) 00000020:00000080:3.0:1788619765.644805:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788619765.644809:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788619765.644811:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788619765.644813:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788619765.644819:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788619765.644867:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006a958aaf from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788619765.644885:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d53a1f73) 00000020:00000080:3.0:1788619765.644894:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788619765.644941:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788619765.644955:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbddfe 00000020:00000080:3.0:1788619765.645036:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788619765.645043:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788619765.645047:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb0e330328bbde05 00080000:01000000:3.0:1788619765.645052:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788619765.645056:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbde0c 00080000:10000000:3.0:1788619765.645588:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788619765.645842:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788619765.649691:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788619765.741939:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788619765.742376:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788619765.746818:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788619765.747146:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788619765.787184:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a42b33ed) 00000020:00000080:2.0:1788619765.787270:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788619765.787341:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788619765.787348:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbde1a 00000020:00000080:1.0:1788619765.789104:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788619765.798337:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788619765.855414:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619765.886388:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788619765.919711:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788619765.978761:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788619766.050349:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788619766.109699:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb0e330328bbde21 00000020:00000080:1.0:1788619766.110687:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788619766.110700:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619766.110706:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619766.110708:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788619766.110712:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619766.110716:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619766.110717:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788619766.110719:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788619766.110721:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788619766.110723:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619766.110732:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619766.110734:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788619766.110737:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619766.110741:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619766.110742:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788619766.110746:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788619766.110813:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788619766.110871:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5865:1875503676916992:0@lo:502: 00000100:00100000:1.0:1788619766.110950:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.111009:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf1c8d89 going to sleep for 11 seconds 00000100:00100000:1.0:1788619766.111036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676916992 00000100:00100000:1.0:1788619766.111041:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676916992 00000100:00100000:1.0:1788619766.111092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788619766.111100:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bf1cb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+9:5865:x1875503676916992:12345-0@lo:502: 00000100:00100000:1.0:1788619766.112856:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bf1cb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+9:5865:x1875503676916992:12345-0@lo:502: Request processed in 1751us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619766.112869:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788619766.114015:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3f66037 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5865:1875503676916992:0@lo:502: 00000020:01000000:3.0:1788619766.114058:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619766.114151:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619766.114154:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788619766.114160:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788619766.114424:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788619766.114570:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788619766.114592:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.114603:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619766.114611:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93338a7b5000 from 1 10000000:01000000:1.0:1788619766.114614:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788619766.114648:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.114671:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.114680:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.114699:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917120:0@lo:101: 00000100:00100000:1.0:1788619766.114759:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.114930:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001aeeb267 going to sleep for 11 seconds 00000100:00100000:2.0:1788619766.115339:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917120 00000100:00100000:2.0:1788619766.115348:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917120 00000100:00100000:2.0:1788619766.115397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788619766.115405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000211b3b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:5821:x1875503676917120:12345-0@lo:101: 00010000:00010000:2.0:1788619766.115694:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619766.115712:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbde28 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.115734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.115743:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.115752:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3d0bd48, rc 0) 00000100:00100000:2.0:1788619766.115839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000211b3b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+10:5821:x1875503676917120:12345-0@lo:101: Request processed in 435us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619766.115846:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788619766.115989:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917120:0@lo:101: 00010000:00010000:1.0:1788619766.116004:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.116012:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.117235:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917248:0@lo:256: 00000100:00100000:1.0:1788619766.117307:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.117467:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001aeeb267 going to sleep for 11 seconds 00000100:00100000:0.0:1788619766.117619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917248 00000100:00100000:0.0:1788619766.117627:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917248 00000100:00100000:0.0:1788619766.117695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788619766.117703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ef1da94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+10:5821:x1875503676917248:12345-0@lo:256: 20000000:01000000:0.0:1788619766.117720:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788619766.117727:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788619766.123018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ef1da94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+10:5821:x1875503676917248:12345-0@lo:256: Request processed in 5307us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619766.123034:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788619766.123258:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917248:0@lo:256: 10000000:01000000:1.0:1788619766.124171:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788619766.124188:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.124199:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619766.124221:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93338a7b5000 from 1 10000000:01000000:1.0:1788619766.124224:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619766.124257:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.124264:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.124273:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.124291:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917376:0@lo:101: 00000100:00100000:1.0:1788619766.124552:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.124695:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001aeeb267 going to sleep for 11 seconds 00000100:00100000:2.0:1788619766.128128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917376 00000100:00100000:2.0:1788619766.128143:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917376 00000100:00100000:2.0:1788619766.128202:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788619766.128210:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000824ada8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+10:5821:x1875503676917376:12345-0@lo:101: 00010000:00010000:2.0:1788619766.128229:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619766.128246:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbde36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.128281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.128291:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.128299:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0b52154, rc 0) 00000100:00100000:2.0:1788619766.128371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000824ada8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917376:12345-0@lo:101: Request processed in 162us (3821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619766.128377:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788619766.129491:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917376:0@lo:101: 00010000:00010000:1.0:1788619766.129512:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.129523:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.129598:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917504:0@lo:501: 00000100:00100000:1.0:1788619766.129640:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.129685:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001aeeb267 going to sleep for 11 seconds 00000100:00100000:0.0:1788619766.129744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917504 00000100:00100000:0.0:1788619766.129758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917504 00000100:00100000:0.0:1788619766.129814:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788619766.129821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e5b31bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917504:12345-0@lo:501: 00000100:00100000:0.0:1788619766.130363:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e5b31bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917504:12345-0@lo:501: Request processed in 543us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619766.130371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788619766.131265:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917504:0@lo:501: 00000100:00100000:1.0:1788619766.131308:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917632:0@lo:503: 00000100:00100000:1.0:1788619766.131365:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.131410:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001aeeb267 going to sleep for 11 seconds 00000100:00100000:0.0:1788619766.131514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917632 00000100:00100000:0.0:1788619766.131520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917632 00000100:00100000:0.0:1788619766.131567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788619766.131573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007411d825 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917632:12345-0@lo:503: 00000040:00080000:0.0:1788619766.131612:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788619766.131661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007411d825 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917632:12345-0@lo:503: Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619766.131669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788619766.132021:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec9e22ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917632:0@lo:503: 00000040:00080000:2.0:1788619766.133296:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788619766.133484:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788619766.133503:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788619766.133518:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619766.133539:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619766.133583:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788619766.133586:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93338a7b5000 10000000:01000000:3.0:1788619766.133589:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93338a7b5000 10000000:01000000:3.0:1788619766.133593:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788619766.133598:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93338a7b5000 from 1 10000000:01000000:3.0:1788619766.133600:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788619766.133633:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619766.133641:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619766.133650:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619766.133668:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917760:0@lo:101: 00000100:00100000:3.0:1788619766.133739:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619766.133768:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a319c287 going to sleep for 11 seconds 00000100:00100000:2.0:1788619766.134586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917760 00000100:00100000:2.0:1788619766.134593:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917760 00000100:00100000:2.0:1788619766.134639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788619766.134647:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035f18021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676917760:12345-0@lo:101: 00010000:00010000:2.0:1788619766.134660:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619766.134671:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbde44 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.134694:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.134704:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.134711:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b79d2bd, rc 0) 00000100:00100000:2.0:1788619766.134792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035f18021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676917760:12345-0@lo:101: Request processed in 145us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619766.134798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788619766.135080:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917760:0@lo:101: 00010000:00010000:3.0:1788619766.135092:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619766.135101:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619766.135151:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917888:0@lo:501: 00000100:00100000:3.0:1788619766.135180:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619766.135199:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a319c287 going to sleep for 11 seconds 00000100:00100000:1.0:1788619766.135252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676917888 00000100:00100000:1.0:1788619766.135257:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676917888 00000100:00100000:1.0:1788619766.135285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788619766.135291:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000680f5ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676917888:12345-0@lo:501: 00000100:00100000:1.0:1788619766.135526:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000680f5ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676917888:12345-0@lo:501: Request processed in 235us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619766.135541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788619766.136567:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676917888:0@lo:501: 00000100:00100000:3.0:1788619766.136616:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676918016:0@lo:503: 00000100:00100000:3.0:1788619766.136676:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619766.136701:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a319c287 going to sleep for 11 seconds 00000100:00100000:2.0:1788619766.136791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918016 00000100:00100000:2.0:1788619766.136796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918016 00000100:00100000:2.0:1788619766.136833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788619766.136840:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c01c268 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676918016:12345-0@lo:503: 00000100:00100000:2.0:1788619766.137168:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c01c268 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676918016:12345-0@lo:503: Request processed in 328us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619766.137177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788619766.137794:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e89b9ed5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676918016:0@lo:503: 00000100:00100000:2.0:1788619766.141902:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c350ab61 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5870:1875503676918144:0@lo:502: 00000100:00100000:2.0:1788619766.141999:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619766.142043:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094070e41 going to sleep for 11 seconds 00000100:00100000:3.0:1788619766.142220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918144 00000100:00100000:3.0:1788619766.142228:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918144 00000100:00100000:3.0:1788619766.142267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788619766.142274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000167fa7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5870:x1875503676918144:12345-0@lo:502: 00000100:00100000:3.0:1788619766.142562:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000167fa7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5870:x1875503676918144:12345-0@lo:502: Request processed in 287us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619766.142570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788619766.142696:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c350ab61 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5870:1875503676918144:0@lo:502: 00000020:01000004:2.0:1788619766.142759:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788619766.142798:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000067644ca7) 00000020:00000080:2.0:1788619766.142818:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788619766.142889:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006a958aaf from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788619766.142892:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006a958aaf from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788619766.142894:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006a958aaf 4 00010000:00080000:2.0:1788619766.142922:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006765fec7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788619766.144616:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788619766.144882:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788619766.144918:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788619766.144943:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb0e330328bbde59 00000100:00080000:2.0:1788619766.144954:0:5870:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788619766.144959:0:5870:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006765fec7 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788619766.144991:0:5870:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c350ab61 x1875503676918272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788619766.145023:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788619766.149037:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c350ab61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503676918272:0@lo:38: 00000100:00100000:3.0:1788619766.149130:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619766.149377:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918272 00000100:00100000:0.0:1788619766.149385:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918272 00000100:00100000:0.0:1788619766.149429:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788619766.149434:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89b9ed5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503676918272:12345-0@lo:38: 00000100:00100000:0.0:1788619766.149492:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89b9ed5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503676918272:12345-0@lo:38: Request processed in 57us (362us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788619766.149499:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788619766.149583:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788619766.149591:0:3308:0:(import.c:65:import_set_state_nolock()) 000000006765fec7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788619766.149594:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788619766.149597:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c350ab61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503676918272:0@lo:38: 00000100:00100000:2.0:1788619766.153044:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5870:1875503676918400:0@lo:502: 00000100:00100000:2.0:1788619766.153258:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619766.153307:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 000000001188bb09 going to sleep for 11 seconds 00000100:00100000:1.0:1788619766.153418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918400 00000100:00100000:1.0:1788619766.153426:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918400 00000100:00100000:1.0:1788619766.153465:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788619766.153473:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035a2c808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:5870:x1875503676918400:12345-0@lo:502: 00000100:00100000:1.0:1788619766.153713:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035a2c808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:5870:x1875503676918400:12345-0@lo:502: Request processed in 240us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619766.153721:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788619766.153837:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:5870:1875503676918400:0@lo:502: 00000040:00080000:2.0:1788619766.153864:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788619766.157076:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788619766.157111:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788619766.157128:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.157140:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788619766.157212:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788619766.157215:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788619766.157216:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788619766.157217:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788619766.157219:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788619766.157225:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788619766.157226:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788619766.157227:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788619766.157228:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788619766.157229:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788619766.157230:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788619766.157232:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788619766.157235:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788619766.157238:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788619766.157239:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788619766.157239:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788619766.157240:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788619766.157241:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788619766.157242:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788619766.157242:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788619766.157243:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788619766.157244:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788619766.157244:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788619766.157245:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788619766.157246:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788619766.157273:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788619766.157290:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057943f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676918528:0@lo:253: 00000100:00100000:1.0:1788619766.157357:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.157393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918528 00000100:00100000:1.0:1788619766.157400:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918528 00000100:00100000:1.0:1788619766.157441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788619766.157449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e00f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:5821:x1875503676918528:12345-0@lo:253: 20000000:01000000:1.0:1788619766.157474:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788619766.157486:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788619766.158878:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026361ea7 going to sleep for 11 seconds 20000000:01000000:2.0:1788619766.182084:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788619766.182104:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788619766.182206:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788619766.182211:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788619766.182230:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.182247:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.182270:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.182314:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.182327:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 12 pid: 5833 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.182341:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5005023 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676918656:0@lo:104: 00000100:00100000:1.0:1788619766.182408:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.182460:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8da2210 going to sleep for 11 seconds 00000100:00100000:2.0:1788619766.183045:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918656 00000100:00100000:2.0:1788619766.183054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918656 00000100:00100000:2.0:1788619766.183163:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619766.183172:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb578ae5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676918656:12345-0@lo:104: 00010000:00010000:2.0:1788619766.183185:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619766.183245:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788619766.183251:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb578ae5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676918656:12345-0@lo:104: Request processed in 81us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619766.183258:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788619766.183315:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619766.183320:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183327:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bec4d14d already unused, calling callback (0000000053806ab7) 10000000:00010000:1.0:1788619766.183329:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183336:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619766.183342:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619766.183347:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619766.183382:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183401:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619766.183420:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183426:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000bec4d14d/0xbb0e330328bbde28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde2f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619766.183442:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619766.183444:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619766.183495:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006195afae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676918784:0@lo:103: 00000100:00100000:1.0:1788619766.183527:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619766.183626:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918784 00000100:00100000:1.0:1788619766.183632:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918784 00010000:00010000:1.0:1788619766.183651:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 13 pid: 5833 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.183674:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619766.183679:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baae5cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+13:3310:x1875503676918784:12345-0@lo:103: 00010000:00010000:1.0:1788619766.183688:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619766.183692:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 13 pid: 5833 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183701:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 13 pid: 5833 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183717:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183735:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788619766.183747:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001537506s 00010000:00010000:1.0:1788619766.183751:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183757:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183763:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183792:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183798:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4fc7283 already unused, calling callback (00000000f3e76063) 00010000:00010000:1.0:1788619766.183800:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183806:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183815:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183824:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619766.183855:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baae5cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+13:3310:x1875503676918784:12345-0@lo:103: Request processed in 176us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619766.183862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619766.183902:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006195afae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676918784:0@lo:103: 00010000:00010000:1.0:1788619766.183929:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3d0bd48/0xbb0e330328bbde2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbde28 expref: 12 pid: 5833 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.183939:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5005023 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676918656:0@lo:104: 00010000:00010000:1.0:1788619766.183950:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183958:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183962:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619766.183967:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbde60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619766.191423:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e00f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:5821:x1875503676918528:12345-0@lo:253: Request processed in 33968us (34059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619766.191438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788619766.191526:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057943f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:5821:1875503676918528:0@lo:253: 10000000:01000000:3.0:1788619766.191551:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788619766.191554:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788619766.191556:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788619766.191558:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788619766.191559:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788619766.191560:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788619766.191561:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788619766.191562:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788619766.191564:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788619766.191565:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788619766.191567:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788619766.191568:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788619766.191570:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788619766.191584:0:5821:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788619766.196669:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.197162:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619766.197362:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.197511:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619766.197709:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.197982:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619766.198863:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.199037:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619766.199331:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.199512:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619766.199719:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619766.199990:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1788619766.215466:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1788619766.238599:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788619766.269484:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788619766.269807:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788619766.272604:0:5875:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788619766.272610:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788619766.274163:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788619766.274334:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788619766.274877:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788619766.274884:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788619766.275002:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619766.276164:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788619766.281585:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788619766.281658:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788619766.281937:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788619766.282134:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788619766.283342:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788619766.283499:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788619766.284678:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788619766.284881:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788619766.285034:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788619766.285466:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788619766.286346:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788619766.286506:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788619766.286667:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788619766.286952:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788619766.287305:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788619766.287462:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788619766.287619:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788619766.287768:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788619766.288014:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788619766.288174:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788619766.288485:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788619766.288647:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788619766.288814:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788619766.288953:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788619766.289386:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788619766.289555:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788619766.289717:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788619766.289913:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788619766.290048:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788619766.290462:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788619766.290640:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788619766.290823:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788619766.290997:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788619766.291160:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788619766.291294:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788619766.291470:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788619766.291690:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788619766.321929:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788619766.370940:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788619766.370972:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc7c01c6f988 00100000:10000000:2.0:1788619766.370980:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788619766.371400:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788619766.371414:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788619766.371429:0:5821:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788619766.371444:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788619766.411599:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788619766.411699:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788619766.411716:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788619767.242950:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619768.263362:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619769.289322:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619770.313323:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788619771.213208:0:6118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788619771.335108:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788619771.590928:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788619771.590946:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788619771.590949:0:496:0:(import.c:65:import_set_state_nolock()) 000000006765fec7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788619771.590964:0:496:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006765fec7 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788619771.590988:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000049fcaa53 x1875503676919040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788619771.591046:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788619771.591061:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000018497bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676918912:0@lo:400: 00000100:00100000:0.0:1788619771.591134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619771.591316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676918912 00000100:00100000:3.0:1788619771.591324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676918912 00000100:00100000:3.0:1788619771.591373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788619771.591383:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000364cc67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:3312:x1875503676918912:12345-0@lo:400: 00000100:00100000:3.0:1788619771.591441:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000364cc67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:3312:x1875503676918912:12345-0@lo:400: Request processed in 60us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619771.591448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788619771.591467:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000018497bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676918912:0@lo:400: 00000100:00100000:1.0:1788619771.591689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049fcaa53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503676919040:0@lo:38: 00000100:00100000:1.0:1788619771.591731:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619771.593191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919040 00000100:00100000:2.0:1788619771.593202:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919040 00000100:00100000:2.0:1788619771.593248:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619771.593254:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5005023 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875503676919040:12345-0@lo:38: 00010000:00080000:2.0:1788619771.593279:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788619771.593316:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb0e330328bbde67 00000004:00100000:2.0:1788619771.593362:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788619771.593489:0:5842:0:(import.c:65:import_set_state_nolock()) 0000000046bd2e58 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619771.593581:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5005023 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875503676919040:12345-0@lo:38: Request processed in 325us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619771.593587:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788619771.595412:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000049fcaa53 x1875503676919040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788619781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788619771.595435:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788619771.595444:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788619771.595451:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788619771.595454:0:3308:0:(import.c:65:import_set_state_nolock()) 000000006765fec7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788619771.595461:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049fcaa53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503676919040:0@lo:38: 00010000:00010000:1.0:1788619772.358923:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619773.383038:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619774.407892:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788619774.665626:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788619774.665634:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93338a7b5000 from 3 10000000:01000000:1.0:1788619774.665639:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788619774.665680:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619774.665692:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619774.665701:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619774.665732:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006195afae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676919168:0@lo:101: 00000100:00100000:1.0:1788619774.665832:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619774.665875:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064872275 going to sleep for 11 seconds 00000100:00100000:2.0:1788619774.666024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919168 00000100:00100000:2.0:1788619774.666033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919168 00000100:00100000:2.0:1788619774.666087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788619774.666095:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b963b95b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:5837:x1875503676919168:12345-0@lo:101: 00010000:00010000:2.0:1788619774.666107:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619774.666119:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000792fae29/0xbb0e330328bbde75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbde6e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619774.666140:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000792fae29/0xbb0e330328bbde75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619774.666149:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000792fae29/0xbb0e330328bbde75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619774.666164:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000792fae29, rc 0) 00000100:00100000:2.0:1788619774.666205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b963b95b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:5837:x1875503676919168:12345-0@lo:101: Request processed in 111us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619774.666212:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788619774.666256:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006195afae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676919168:0@lo:101: 00010000:00010000:2.0:1788619774.666269:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619774.666276:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619774.666319:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676919296:0@lo:256: 00000100:00100000:2.0:1788619774.666346:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619774.666360:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1205b3f going to sleep for 11 seconds 00000100:00100000:2.0:1788619774.666374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919296 00000100:00100000:2.0:1788619774.666377:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919296 00000100:00100000:2.0:1788619774.666397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788619774.666402:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa21d9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5837:x1875503676919296:12345-0@lo:256: 20000000:01000000:2.0:1788619774.666415:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788619774.666428:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788619774.666431:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788619774.666512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa21d9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5837:x1875503676919296:12345-0@lo:256: Request processed in 109us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619774.666518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788619774.666546:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676919296:0@lo:256: 10000000:01000000:2.0:1788619774.666580:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788619774.666589:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619774.666596:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000003f050f37/0xbb0e330328bbde6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.431008:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788619775.897139:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc3b01540 20000000:00000080:0.0:1788619775.897157:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9333bd335800 uarg=0000000000000000 20000000:01000000:0.0:1788619775.897196:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788619775.897203:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788619775.897208:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788619775.903424:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788619775.903441:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788619775.913496:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788619775.914962:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788619775.915112:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788619775.915168:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788619775.915187:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788619775.915205:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.915224:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.915232:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.915280:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.915294:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 11 pid: 5833 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619775.915308:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf0bebfb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875503676919424:0@lo:104: 00000100:00100000:0.0:1788619775.915373:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619775.915430:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ada2fcba going to sleep for 11 seconds 00000100:00100000:1.0:1788619775.917891:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919424 00000100:00100000:1.0:1788619775.917905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919424 00000100:00100000:1.0:1788619775.917953:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788619775.917960:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b574f56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:6320:x1875503676919424:12345-0@lo:104: 00010000:00010000:1.0:1788619775.917975:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918063:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619775.918068:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b574f56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:6320:x1875503676919424:12345-0@lo:104: Request processed in 108us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619775.918074:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788619775.918097:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619775.918102:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918109:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d216cada already unused, calling callback (0000000053806ab7) 10000000:00010000:1.0:1788619775.918112:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918119:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619775.918125:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619775.918147:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788619775.918175:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf0bebfb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875503676919424:0@lo:104: 00010000:00010000:1.0:1788619775.918178:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918184:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619775.918194:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918200:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918206:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000d216cada/0xbb0e330328bbde36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde3d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619775.918223:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619775.918225:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619775.918226:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619775.918243:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdfe372e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676919552:0@lo:103: 00000100:00100000:1.0:1788619775.918281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619775.918356:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919552 00000100:00100000:3.0:1788619775.918361:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919552 00010000:00010000:3.0:1788619775.918380:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 12 pid: 5833 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619775.918408:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788619775.918414:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af91a14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+12:3312:x1875503676919552:12345-0@lo:103: 00010000:00010000:3.0:1788619775.918424:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619775.918428:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 12 pid: 5833 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918437:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 12 pid: 5833 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0b52154/0xbb0e330328bbde3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbde36 expref: 12 pid: 5833 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918471:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918478:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918490:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918496:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918501:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918512:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918517:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048abe7ed already unused, calling callback (00000000f3e76063) 00010000:00010000:3.0:1788619775.918521:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918527:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918545:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619775.918554:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619775.918584:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af91a14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+11:3312:x1875503676919552:12345-0@lo:103: Request processed in 169us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619775.918590:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788619775.918635:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.918643:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619775.918653:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048abe7ed/0xbb0e330328bbde7c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619775.921458:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdfe372e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676919552:0@lo:103: 00010000:00010000:1.0:1788619776.455480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619776.711075:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676919680:0@lo:400: 00000100:00100000:1.0:1788619776.711153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619776.711191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919680 00000100:00100000:2.0:1788619776.711199:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919680 00000100:00100000:1.0:1788619776.711220:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619776.711226:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9c6cdb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676919808:0@lo:400: 00000100:00100000:2.0:1788619776.711259:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788619776.711268:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619776.711271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002374fbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:3309:x1875503676919680:12345-0@lo:400: 00000100:00100000:1.0:1788619776.711305:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919808 00000100:00100000:1.0:1788619776.711309:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919808 00000100:00100000:2.0:1788619776.711321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002374fbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:3309:x1875503676919680:12345-0@lo:400: Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619776.711328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788619776.711335:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619776.711340:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdfe372e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676919808:12345-0@lo:400: 00000100:00100000:1.0:1788619776.711376:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdfe372e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676919808:12345-0@lo:400: Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619776.711382:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788619776.721399:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f9c6cdb7 x1875503676919808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619776.721417:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9c6cdb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676919808:0@lo:400: 00000100:00100000:1.0:1788619776.721429:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003166c425 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676919680:0@lo:400: 00010000:00010000:1.0:1788619777.479070:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619778.502932:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619779.527200:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619780.552512:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619781.577140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788619781.634678:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788619781.634682:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788619781.634862:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000352040c7 00000020:01000004:0.0:1788619781.634877:0:6687:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788619781.634887:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788619781.634906:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000000bd151a7) 00000020:00000080:0.0:1788619781.634920:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788619781.653854:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788619781.654168:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788619781.675467:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788619781.683273:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788619781.683309:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788619781.683363:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788619781.683400:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788619781.683733:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788619781.683743:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788619781.683754:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbde8a 00000020:01000004:2.0:1788619781.683762:0:6687:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788619781.683879:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788619781.683882:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788619781.683887:0:6687:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788619781.683892:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788619781.683903:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000075c95517) 00000020:00000080:2.0:1788619781.683913:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788619781.685279:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619781.685514:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788619781.685521:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788619781.694439:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788619781.694456:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788619781.698026:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788619781.698038:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788619781.700016:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788619781.700206:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788619781.700212:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788619781.701055:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788619781.701065:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788619781.729011:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788619781.729286:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788619781.729293:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788619781.730555:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788619781.730565:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788619781.732276:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788619781.732288:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788619781.738402:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788619781.738612:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788619781.738618:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788619781.739911:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788619781.739925:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788619781.782449:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788619781.782646:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788619781.782651:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788619781.784577:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788619781.784589:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788619781.784996:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788619781.785020:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788619781.785026:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788619781.806506:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788619781.806546:0:6687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788619781.806550:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788619781.806552:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788619781.806553:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788619781.806558:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788619781.806559:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788619781.806560:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788619781.806561:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788619781.806562:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788619781.806563:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788619781.806565:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788619781.806566:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788619781.806569:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788619781.806571:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788619781.806572:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788619781.806573:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788619781.806574:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788619781.806575:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788619781.806575:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788619781.806576:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788619781.806577:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788619781.806578:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788619781.806579:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788619781.806579:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788619781.806604:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788619781.806619:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055b64b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676919936:0@lo:253: 00000100:00100000:1.0:1788619781.806686:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.806745:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b63fbabe going to sleep for 11 seconds 00000100:00100000:3.0:1788619781.807329:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676919936 00000100:00100000:3.0:1788619781.807345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676919936 00000100:00100000:3.0:1788619781.807432:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788619781.807440:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007054b806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676919936:12345-0@lo:253: 20000000:01000000:3.0:1788619781.807465:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788619781.807469:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788619781.807474:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788619781.807477:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788619781.808308:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619781.808519:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788619781.808534:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788619781.808566:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788619781.808572:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788619781.808597:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788619781.808636:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788619781.809006:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788619781.809024:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1788619781.809026:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788619781.809053:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788619781.809059:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788619781.809107:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788619781.809113:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788619781.809138:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788619781.809145:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788619781.809168:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788619781.809204:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788619781.809945:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788619781.809960:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1788619781.809962:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788619781.809989:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788619781.809995:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788619781.810017:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788619781.810022:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788619781.810056:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788619781.810063:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788619781.810087:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788619781.810112:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788619781.810125:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788619781.810128:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788619781.810136:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788619781.810146:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788619781.810149:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788619781.810177:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788619781.810179:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788619781.811074:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788619781.811450:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788619781.811494:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788619781.811552:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788619781.811566:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788619781.811568:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788619781.812057:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788619781.812108:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788619781.812238:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788619781.812973:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788619781.813017:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788619781.813088:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788619781.813101:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788619781.813103:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788619781.813632:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788619781.813675:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788619781.813730:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788619781.814045:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788619781.814401:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788619781.814453:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788619781.814468:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788619781.814470:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788619781.814478:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788619781.814493:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814510:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814517:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814524:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814530:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814569:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814582:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 11 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.814595:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004946e49 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920064:0@lo:104: 00000100:00100000:3.0:1788619781.814652:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788619781.814745:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.814753:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 11 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.814761:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000207c8555 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920192:0@lo:104: 00000100:00100000:3.0:1788619781.814861:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788619781.815121:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.815130:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 11 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.815138:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000faa75016 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920320:0@lo:104: 00000100:00100000:3.0:1788619781.815157:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.815213:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920064 00000100:00100000:1.0:1788619781.815221:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920064 00000100:00100000:1.0:1788619781.815250:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920192 00000100:00100000:1.0:1788619781.815253:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920192 00000100:00100000:1.0:1788619781.815266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619781.815273:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b26c8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+4:5834:x1875503676920064:12345-0@lo:104: 00010000:00010000:1.0:1788619781.815284:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815344:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619781.815349:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b26c8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+4:5834:x1875503676920064:12345-0@lo:104: Request processed in 77us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.815364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619781.815381:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619781.815385:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000284b7e96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676920192:12345-0@lo:104: 00010000:00010000:1.0:1788619781.815392:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815438:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788619781.815442:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000284b7e96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676920192:12345-0@lo:104: Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.815447:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788619781.815464:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788619781.815468:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815474:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c7180e1 already unused, calling callback (0000000053806ab7) 10000000:00010000:1.0:1788619781.815476:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815484:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619781.815489:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619781.815495:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619781.815519:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815525:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619781.815546:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815553:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000000c7180e1/0xbb0e330328bbde44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde4b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815565:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619781.815567:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815573:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e72bf51b already unused, calling callback (0000000053806ab7) 10000000:00010000:1.0:1788619781.815575:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815580:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619781.815585:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619781.815589:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619781.815601:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815606:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619781.815610:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815615:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbddd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdddb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815624:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619781.815631:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619781.815632:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619781.815652:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676920448:0@lo:103: 00000100:00100000:1.0:1788619781.815689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.815711:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619781.815716:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000842b75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676920576:0@lo:103: 00000100:00100000:1.0:1788619781.815732:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.815757:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920448 00000100:00100000:1.0:1788619781.815760:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920448 00010000:00010000:1.0:1788619781.815791:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 12 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619781.815808:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920576 00000100:00100000:1.0:1788619781.815811:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920576 00010000:00010000:1.0:1788619781.815819:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 13 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619781.815829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619781.815833:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39e2f83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+13:3311:x1875503676920448:12345-0@lo:103: 00010000:00010000:1.0:1788619781.815842:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619781.815846:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 13 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815855:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 13 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815868:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619781.815892:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39e2f83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+13:3311:x1875503676920448:12345-0@lo:103: Request processed in 58us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.815897:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619781.815915:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619781.815920:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db2797da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+12:3311:x1875503676920576:12345-0@lo:103: 00010000:00010000:1.0:1788619781.815926:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619781.815930:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 12 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815936:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 12 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.815944:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619781.815962:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db2797da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+12:3311:x1875503676920576:12345-0@lo:103: Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.815967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619781.815998:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000842b75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676920576:0@lo:103: 00000100:00100000:1.0:1788619781.816004:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676920448:0@lo:103: 00010000:00010000:2.0:1788619781.817816:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619781.818130:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920320 00000100:00100000:0.0:1788619781.818142:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920320 00000100:00100000:3.0:1788619781.818179:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002443a35 going to sleep for 11 seconds 00010000:00010000:3.0:1788619781.818207:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b79d2bd/0xbb0e330328bbde4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbde44 expref: 11 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.818222:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004946e49 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920064:0@lo:104: 00010000:00010000:3.0:1788619781.818257:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b472a650/0xbb0e330328bbdddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbddd4 expref: 10 pid: 5833 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.818267:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000207c8555 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920192:0@lo:104: 00000100:00100000:1.0:1788619781.818543:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788619781.818554:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dc0cc75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676920320:12345-0@lo:104: 00010000:00010000:1.0:1788619781.818568:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.818668:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619781.818673:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dc0cc75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676920320:12345-0@lo:104: Request processed in 123us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.818681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788619781.818737:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000faa75016 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676920320:0@lo:104: 00010000:00010000:3.0:1788619781.818758:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.818829:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619781.818834:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.818841:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005937abe1 already unused, calling callback (0000000053806ab7) 10000000:00010000:2.0:1788619781.818844:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.818852:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788619781.818858:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619781.818863:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788619781.818900:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.818907:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619781.818926:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.818948:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbddb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbddbf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619781.818962:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676920704:0@lo:103: 00010000:00010000:2.0:1788619781.818964:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619781.818968:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619781.818971:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619781.819007:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619781.819312:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920704 00000100:00100000:3.0:1788619781.819318:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920704 00010000:00010000:3.0:1788619781.819397:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 10 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619781.819460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788619781.819467:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049656925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+10:3309:x1875503676920704:12345-0@lo:103: 00010000:00010000:3.0:1788619781.819478:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619781.819483:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 10 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819493:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 10 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819504:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbddbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbddb8 expref: 10 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819516:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819523:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819545:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819552:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819558:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819564:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819569:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000abecbf80 already unused, calling callback (00000000f3e76063) 00010000:00010000:3.0:1788619781.819572:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819578:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819601:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.819609:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619781.819649:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049656925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+9:3309:x1875503676920704:12345-0@lo:103: Request processed in 183us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619781.819656:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788619781.819697:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.819714:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.819720:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abecbf80/0xbb0e330328bbde98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788619781.819732:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788619781.822129:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676920704:0@lo:103: 00000100:00100000:1.0:1788619781.831465:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619781.831489:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676920832:0@lo:400: 00000100:00100000:1.0:1788619781.831557:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.831627:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920832 00000100:00100000:1.0:1788619781.831634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920832 00000100:00100000:1.0:1788619781.831683:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788619781.831691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000842b75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676920832:12345-0@lo:400: 00000100:00100000:1.0:1788619781.831747:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000842b75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676920832:12345-0@lo:400: Request processed in 57us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.831755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788619781.831822:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008b3d8661 x1875503676920832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619781.831836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676920832:0@lo:400: 00000100:00100000:3.0:1788619781.924356:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007054b806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+8:6687:x1875503676919936:12345-0@lo:253: Request processed in 116908us (117662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619781.924372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788619781.924647:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055b64b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676919936:0@lo:253: 10000000:01000000:2.0:1788619781.924664:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788619781.924667:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788619781.924669:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788619781.924670:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619781.924671:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788619781.924673:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619781.924674:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619781.924675:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788619781.924676:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788619781.924677:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619781.924679:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788619781.924697:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000352040c7 from lustre-OST0000 10000000:01000000:2.0:1788619781.924721:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788619781.924724:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788619781.924729:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9333871319c0 local copy 10000000:01000000:2.0:1788619781.924733:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788619781.924766:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.924808:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.924816:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619781.924847:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676920960:0@lo:101: 00000100:00100000:2.0:1788619781.924887:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.924939:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c55d444 going to sleep for 11 seconds 00000100:00100000:0.0:1788619781.925104:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676920960 00000100:00100000:0.0:1788619781.925112:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676920960 00000100:00100000:0.0:1788619781.925156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788619781.925165:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000129adae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+8:6687:x1875503676920960:12345-0@lo:101: 00010000:00010000:0.0:1788619781.925177:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619781.925189:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079e6aa09/0xbb0e330328bbdea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbde9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.925212:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079e6aa09/0xbb0e330328bbdea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbde9f expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.925222:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079e6aa09/0xbb0e330328bbdea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde9f expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.925231:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079e6aa09, rc 0) 00000100:00100000:0.0:1788619781.925265:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000129adae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:6687:x1875503676920960:12345-0@lo:101: Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619781.925270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788619781.925458:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676920960:0@lo:101: 00010000:00010000:2.0:1788619781.925471:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.925478:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619781.925576:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921088:0@lo:501: 00000100:00100000:2.0:1788619781.925619:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.925641:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c55d444 going to sleep for 11 seconds 00000100:00100000:3.0:1788619781.926454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921088 00000100:00100000:3.0:1788619781.926472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921088 00000100:00100000:3.0:1788619781.926516:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788619781.926523:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adb0551b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+9:6687:x1875503676921088:12345-0@lo:501: 00000100:00100000:3.0:1788619781.926745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adb0551b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+9:6687:x1875503676921088:12345-0@lo:501: Request processed in 222us (1126us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788619781.926753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788619781.927463:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921088:0@lo:501: 10000000:01000000:2.0:1788619781.927484:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788619781.927523:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788619781.927529:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.927540:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.927546:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.927571:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788619781.927598:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9333bbf76000 10000000:01000000:2.0:1788619781.927603:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788619781.927608:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9333871319c0 10000000:01000000:2.0:1788619781.927610:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788619781.927614:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9333871319c0 from 1 10000000:01000000:2.0:1788619781.927616:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788619781.927641:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.927649:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.927658:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619781.927674:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921216:0@lo:101: 00000100:00100000:2.0:1788619781.927710:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.927745:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00010000:00010000:1.0:1788619781.927809:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619781.927815:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.927822:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005937abe1 already unused, calling callback (0000000053806ab7) 10000000:00010000:1.0:1788619781.927825:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.927832:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619781.927837:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619781.927842:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619781.927862:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.927867:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619781.927916:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.927923:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000005937abe1/0xbb0e330328bbde9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdea6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.927937:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619781.927938:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619781.927940:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619781.928047:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788619781.928060:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676921344:0@lo:103: 00000100:00100000:0.0:1788619781.928093:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619781.928493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921344 00000100:00100000:1.0:1788619781.928501:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921344 00000100:00100000:1.0:1788619781.928548:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619781.928555:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e09eced pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+9:3312:x1875503676921344:12345-0@lo:103: 00010000:00010000:1.0:1788619781.928567:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619781.928579:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079e6aa09/0xbb0e330328bbdea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbde9f expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619781.928593:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619781.928630:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e09eced pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+8:3312:x1875503676921344:12345-0@lo:103: Request processed in 76us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.928636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619781.928664:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676921344:0@lo:103: 00000100:00100000:3.0:1788619781.928834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921216 00000100:00100000:3.0:1788619781.928839:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921216 00000100:00100000:3.0:1788619781.928870:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788619781.928876:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d083db58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+8:6687:x1875503676921216:12345-0@lo:101: 00010000:00010000:3.0:1788619781.928887:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619781.928898:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbdeb4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdead expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.928915:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbdeb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdead expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.928924:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8096f5b/0xbb0e330328bbdeb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdead expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619781.928930:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8096f5b, rc 0) 00000100:00100000:3.0:1788619781.929081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d083db58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+9:6687:x1875503676921216:12345-0@lo:101: Request processed in 205us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619781.929088:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788619781.929450:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921216:0@lo:101: 00010000:00010000:2.0:1788619781.929464:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.929472:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619781.929488:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788619781.929504:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.929511:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000006c7b477d/0xbb0e330328bbdead lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619781.929529:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788619781.929533:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788619781.929539:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788619781.929541:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788619781.929562:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.929569:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.929576:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619781.929592:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921472:0@lo:101: 00000100:00100000:2.0:1788619781.929625:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.929694:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788619781.933564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921472 00000100:00100000:0.0:1788619781.933581:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921472 00000100:00100000:0.0:1788619781.933701:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788619781.933711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8e7389c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+9:6687:x1875503676921472:12345-0@lo:101: 00010000:00010000:0.0:1788619781.933728:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619781.933747:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb53fea8/0xbb0e330328bbdec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdebb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.933801:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb53fea8/0xbb0e330328bbdec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.933812:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb53fea8/0xbb0e330328bbdec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619781.933821:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb53fea8, rc 0) 00000100:00100000:0.0:1788619781.933901:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8e7389c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921472:12345-0@lo:101: Request processed in 192us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619781.933908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788619781.934016:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921472:0@lo:101: 00010000:00010000:2.0:1788619781.934036:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619781.934045:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619781.934156:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921600:0@lo:501: 00000100:00100000:2.0:1788619781.934192:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619781.939334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921600 00000100:00100000:3.0:1788619781.939352:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921600 00000100:00100000:1.0:1788619781.939616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788619781.939629:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029aee61a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921600:12345-0@lo:501: 00000100:00100000:1.0:1788619781.939964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029aee61a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921600:12345-0@lo:501: Request processed in 338us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.939973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788619781.942098:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00000100:00100000:2.0:1788619781.942130:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921600:0@lo:501: 00000100:00100000:2.0:1788619781.942206:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921728:0@lo:503: 00000100:00100000:2.0:1788619781.942267:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.942283:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00000100:00100000:3.0:1788619781.944476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921728 00000100:00100000:3.0:1788619781.944489:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921728 00000100:00100000:3.0:1788619781.944544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788619781.944552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000467993e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921728:12345-0@lo:503: 00000100:00100000:3.0:1788619781.944814:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000467993e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921728:12345-0@lo:503: Request processed in 262us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619781.944822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788619781.946090:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921728:0@lo:503: 00000040:00080000:2.0:1788619781.946444:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788619781.946519:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921856:0@lo:502: 00000100:00100000:2.0:1788619781.946579:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.948628:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788619781.949468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921856 00000100:00100000:1.0:1788619781.949494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921856 00000100:00100000:1.0:1788619781.949614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788619781.949623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f4cb4c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921856:12345-0@lo:502: 00000100:00100000:1.0:1788619781.949930:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f4cb4c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921856:12345-0@lo:502: Request processed in 309us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619781.949939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788619781.954986:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921856:0@lo:502: 00000040:00080000:2.0:1788619781.955323:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788619781.955395:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788619781.955439:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788619781.955487:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788619781.955524:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788619781.955558:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788619781.955594:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921984:0@lo:502: 00000100:00100000:2.0:1788619781.955665:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619781.962196:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef7073d6 going to sleep for 11 seconds 00000100:00100000:3.0:1788619781.963459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676921984 00000100:00100000:3.0:1788619781.963473:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676921984 00000100:00100000:0.0:1788619781.963573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788619781.963584:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed4f32f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921984:12345-0@lo:502: 00000100:00100000:0.0:1788619781.963864:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed4f32f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676921984:12345-0@lo:502: Request processed in 283us (8199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619781.963872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788619781.966220:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063de6e66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676921984:0@lo:502: 00000040:00080000:2.0:1788619781.966410:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788619781.966435:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788619781.967628:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788619781.967638:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788619781.967645:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788619781.967647:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788619781.967653:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788619781.967685:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000004e4c8d04) 00000020:00000080:2.0:1788619781.967711:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788619781.967719:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788619781.967825:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000352040c7 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788619781.967833:0:6706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788619781.967839:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbded0 00010000:00010000:2.0:1788619781.979324:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788619781.984240:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788619781.997409:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788619781.998118:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788619782.019648:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788619782.022088:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788619782.025168:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788619782.025183:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619782.025190:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619782.025192:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788619782.025195:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619782.025199:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619782.025200:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788619782.025203:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788619782.025204:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788619782.025260:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619782.025263:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619782.025265:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788619782.025268:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788619782.027075:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788619782.027104:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788619782.027127:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.027139:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000065c55b0b/0xbb0e330328bbdebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619782.027147:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bbf76000 from 1 10000000:01000000:1.0:1788619782.027149:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619782.027183:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbded7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.027189:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbded7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.027198:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbded7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619782.027217:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922112:0@lo:101: 00000100:00100000:1.0:1788619782.027274:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.027312:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072449150 going to sleep for 11 seconds 00000100:00100000:1.0:1788619782.027679:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922112 00000100:00100000:1.0:1788619782.027686:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922112 00000100:00100000:1.0:1788619782.029495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788619782.029511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001009fb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+10:6687:x1875503676922112:12345-0@lo:101: 00010000:00010000:1.0:1788619782.029530:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619782.029547:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbdede lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbded7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.029572:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbdede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.029582:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4fc7283/0xbb0e330328bbdede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.029591:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4fc7283, rc 0) 00000100:00100000:1.0:1788619782.029657:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001009fb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922112:12345-0@lo:101: Request processed in 151us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.029663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788619782.033295:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922112:0@lo:101: 00010000:00010000:1.0:1788619782.033321:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbded7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.033345:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e72bf51b/0xbb0e330328bbded7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619782.033470:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922240:0@lo:501: 00000100:00100000:1.0:1788619782.033643:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.033686:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072449150 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.033763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922240 00000100:00100000:0.0:1788619782.033798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922240 00000100:00100000:0.0:1788619782.033833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788619782.033840:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003855c75a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922240:12345-0@lo:501: 00000100:00100000:0.0:1788619782.034176:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003855c75a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922240:12345-0@lo:501: Request processed in 335us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.034191:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788619782.034277:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922240:0@lo:501: 00000100:00100000:1.0:1788619782.034309:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922368:0@lo:503: 00000100:00100000:1.0:1788619782.034366:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.034396:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072449150 going to sleep for 11 seconds 00000100:00100000:3.0:1788619782.034510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922368 00000100:00100000:3.0:1788619782.034516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922368 00000100:00100000:3.0:1788619782.034549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788619782.034556:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c527eb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922368:12345-0@lo:503: 00000100:00100000:3.0:1788619782.034754:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c527eb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922368:12345-0@lo:503: Request processed in 198us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619782.034762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788619782.034947:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922368:0@lo:503: 00000040:00080000:1.0:1788619782.035188:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788619782.035240:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922496:0@lo:502: 00000100:00100000:1.0:1788619782.035274:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.035303:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072449150 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.035471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922496 00000100:00100000:0.0:1788619782.035477:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922496 00000100:00100000:0.0:1788619782.035519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788619782.035525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003032ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922496:12345-0@lo:502: 00000100:00100000:0.0:1788619782.035662:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003032ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922496:12345-0@lo:502: Request processed in 137us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.035669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788619782.035874:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922496:0@lo:502: 00000040:00080000:1.0:1788619782.036153:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788619782.036198:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788619782.036220:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922624:0@lo:502: 00000100:00100000:1.0:1788619782.036253:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.036312:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072449150 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.037277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922624 00000100:00100000:0.0:1788619782.037285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922624 00000100:00100000:0.0:1788619782.037437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788619782.037445:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082c2b3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922624:12345-0@lo:502: 00000100:00100000:0.0:1788619782.037717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082c2b3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922624:12345-0@lo:502: Request processed in 273us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.037725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788619782.037820:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b3d8661 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922624:0@lo:502: 00000040:00080000:1.0:1788619782.037935:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788619782.037949:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788619782.038628:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619782.038638:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.038641:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788619782.038648:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333bbf76000 00000020:00000080:1.0:1788619782.038650:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788619782.038686:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619782.038690:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.038692:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788619782.038695:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788619782.038840:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788619782.038866:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788619782.038887:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.038897:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619782.038935:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788619782.038938:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9333bbf76000 10000000:01000000:3.0:1788619782.038940:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9333bbf76000 10000000:01000000:3.0:1788619782.038944:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788619782.038949:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333bbf76000 from 1 10000000:01000000:3.0:1788619782.039052:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788619782.039085:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.039093:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.039104:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619782.039122:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922752:0@lo:101: 00000100:00100000:3.0:1788619782.039173:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.039321:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.039472:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922752 00000100:00100000:2.0:1788619782.039480:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922752 00000100:00100000:2.0:1788619782.039587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788619782.039594:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+11:6687:x1875503676922752:12345-0@lo:101: 00010000:00010000:2.0:1788619782.039607:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619782.039619:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdee5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.039639:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.039649:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.039658:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea800, rc 0) 00000100:00100000:2.0:1788619782.039701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676922752:12345-0@lo:101: Request processed in 108us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.039707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788619782.039804:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922752:0@lo:101: 00010000:00010000:3.0:1788619782.039818:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.039826:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619782.039913:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922880:0@lo:501: 00000100:00100000:3.0:1788619782.039936:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.039961:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.040095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676922880 00000100:00100000:2.0:1788619782.040099:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676922880 00000100:00100000:2.0:1788619782.040116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788619782.040121:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676922880:12345-0@lo:501: 00000100:00100000:2.0:1788619782.040339:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676922880:12345-0@lo:501: Request processed in 208us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.040352:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788619782.040586:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676922880:0@lo:501: 00000100:00100000:3.0:1788619782.040614:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923008:0@lo:503: 00000100:00100000:3.0:1788619782.040653:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.040682:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.040727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923008 00000100:00100000:0.0:1788619782.040732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923008 00000100:00100000:0.0:1788619782.040751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788619782.040757:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923008:12345-0@lo:503: 00000100:00100000:0.0:1788619782.040908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923008:12345-0@lo:503: Request processed in 150us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.040915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788619782.040995:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923008:0@lo:503: 00000040:00080000:3.0:1788619782.041236:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788619782.041302:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923136:0@lo:502: 00000100:00100000:3.0:1788619782.041346:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.041371:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.041832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923136 00000100:00100000:0.0:1788619782.041838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923136 00000100:00100000:0.0:1788619782.041863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788619782.041870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923136:12345-0@lo:502: 00000100:00100000:0.0:1788619782.042065:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923136:12345-0@lo:502: Request processed in 195us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.042072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788619782.042273:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923136:0@lo:502: 00000040:00080000:3.0:1788619782.042674:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788619782.042724:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788619782.042758:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788619782.043021:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788619782.043056:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788619782.043096:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788619782.043126:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788619782.043153:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788619782.043192:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788619782.043223:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788619782.043252:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788619782.043292:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788619782.043322:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788619782.043549:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788619782.043605:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788619782.043640:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788619782.043670:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788619782.043714:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788619782.043748:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788619782.043816:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788619782.043867:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788619782.043900:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788619782.044293:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788619782.044432:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788619782.044566:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788619782.044621:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788619782.044673:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788619782.044711:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788619782.044758:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923264:0@lo:502: 00000100:00100000:0.0:1788619782.044940:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.045148:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9332849186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619782.045261:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923264 00000100:00100000:1.0:1788619782.045269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923264 00000100:00100000:3.0:1788619782.045401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788619782.045411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923264:12345-0@lo:502: 00000100:00100000:3.0:1788619782.045763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923264:12345-0@lo:502: Request processed in 353us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619782.045796:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788619782.046054:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923264:0@lo:502: 00000040:00080000:0.0:1788619782.046138:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788619782.046152:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788619782.047169:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788619782.047185:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9333bd1d3380) 00000020:00000080:0.0:1788619782.047204:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788619782.047269:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333bbf76000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788619782.047274:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333bbf76000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788619782.047276:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333bbf76000 3 00010000:00080000:0.0:1788619782.047303:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333c1e01000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788619782.050197:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788619782.050463:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788619782.050576:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788619782.050590:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb0e330328bbdefa 00000100:00080000:0.0:1788619782.050600:0:6711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788619782.050605:0:6711:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333c1e01000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788619782.050640:0:6711:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333909d9500 x1875503676923392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788619782.050667:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788619782.050760:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503676923392:0@lo:38: 00000100:00100000:3.0:1788619782.050849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788619782.051440:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788619782.051676:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788619782.051705:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788619782.051728:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.051739:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788619782.051815:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788619782.051821:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788619782.051822:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788619782.051823:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788619782.051825:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788619782.051826:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788619782.051827:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788619782.051829:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788619782.051830:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788619782.051832:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788619782.051833:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788619782.051837:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788619782.051839:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788619782.051840:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788619782.051842:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788619782.051843:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788619782.051844:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788619782.051845:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788619782.051846:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788619782.051847:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788619782.051848:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788619782.051849:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788619782.051850:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788619782.051869:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788619782.051882:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923520:0@lo:253: 00000100:00100000:0.0:1788619782.051931:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.052268:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff933284918180 going to sleep for 11 seconds 00000100:00100000:3.0:1788619782.052588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923520 00000100:00100000:3.0:1788619782.052595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923520 00000100:00100000:3.0:1788619782.052644:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788619782.052654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:6687:x1875503676923520:12345-0@lo:253: 20000000:01000000:3.0:1788619782.052684:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788619782.052697:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788619782.053581:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676923648:0@lo:400: 00000100:00100000:0.0:1788619782.053652:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.054281:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923392 00000100:00100000:1.0:1788619782.054295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923392 00000100:00100000:1.0:1788619782.054341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923648 00000100:00100000:1.0:1788619782.054344:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923648 00000100:00100000:1.0:1788619782.054367:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619782.054375:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676923648:12345-0@lo:400: 00000100:00100000:1.0:1788619782.054447:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676923648:12345-0@lo:400: Request processed in 72us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.054453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619782.054468:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788619782.054472:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875503676923392:12345-0@lo:38: 00010000:00080000:1.0:1788619782.054501:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1788619782.054534:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb0e330328bbdf01 00000004:00100000:1.0:1788619782.054547:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788619782.054576:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9333bbd77800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788619782.054617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875503676923392:12345-0@lo:38: Request processed in 143us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.054623:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788619782.054664:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333909d9500 x1875503676923392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788619792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619782.054675:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788619782.054683:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788619782.054690:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788619782.054694:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788619782.054696:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788619782.054702:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503676923392:0@lo:38: 00010000:00080000:1.0:1788619782.054731:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333b94fc380 x1875503676923648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619782.054748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676923648:0@lo:400: 10000000:01000000:2.0:1788619782.060121:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788619782.060129:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93338a7b5000 from 21 10000000:01000000:2.0:1788619782.060134:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788619782.060175:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.060188:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.060198:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.060221:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676923776:0@lo:101: 00000100:00100000:2.0:1788619782.060288:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.060949:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.064600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923776 00000100:00100000:0.0:1788619782.064614:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923776 00000100:00100000:0.0:1788619782.064671:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788619782.064681:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676923776:12345-0@lo:101: 00010000:00010000:0.0:1788619782.064698:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619782.064716:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf08 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.064755:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.064766:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.065024:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031600, rc 0) 00000100:00100000:0.0:1788619782.065094:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676923776:12345-0@lo:101: Request processed in 414us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.065101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788619782.065211:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676923776:0@lo:101: 00010000:00010000:2.0:1788619782.065232:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.065243:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.065305:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676923904:0@lo:501: 00000100:00100000:2.0:1788619782.065336:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.065366:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619782.065415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676923904 00000100:00100000:1.0:1788619782.065432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676923904 00000100:00100000:1.0:1788619782.065459:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788619782.065471:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676923904:12345-0@lo:501: 00000100:00100000:1.0:1788619782.065802:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676923904:12345-0@lo:501: Request processed in 335us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.065810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788619782.065880:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676923904:0@lo:501: 00000100:00100000:0.0:1788619782.065912:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924032:0@lo:503: 00000100:00100000:0.0:1788619782.066017:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.066038:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933284918300 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.066050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924032 00000100:00100000:0.0:1788619782.066054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924032 00000100:00100000:0.0:1788619782.066083:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788619782.066090:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676924032:12345-0@lo:503: 00000100:00100000:0.0:1788619782.066234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676924032:12345-0@lo:503: Request processed in 144us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.066241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788619782.066308:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924032:0@lo:503: 00000100:00100000:2.0:1788619782.068540:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6714:1875503676924160:0@lo:502: 00000100:00100000:2.0:1788619782.070216:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.070288:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619782.070343:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924160 00000100:00100000:1.0:1788619782.070351:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924160 00000100:00100000:1.0:1788619782.070388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788619782.070396:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:6714:x1875503676924160:12345-0@lo:502: 00000100:00100000:1.0:1788619782.070677:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:6714:x1875503676924160:12345-0@lo:502: Request processed in 281us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.070685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788619782.071368:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6714:1875503676924160:0@lo:502: 00000100:00100000:0.0:1788619782.071516:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6714:1875503676924288:0@lo:502: 00000100:00100000:0.0:1788619782.071687:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.071755:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff933284918cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.071876:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924288 00000100:00100000:2.0:1788619782.071881:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924288 00000100:00100000:3.0:1788619782.072004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788619782.072012:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:6714:x1875503676924288:12345-0@lo:502: 00000100:00100000:3.0:1788619782.072194:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:6714:x1875503676924288:12345-0@lo:502: Request processed in 182us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619782.072202:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788619782.072405:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6714:1875503676924288:0@lo:502: 00000040:00080000:1.0:1788619782.072441:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788619782.073998:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788619782.074023:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788619782.074033:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.074046:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619782.074056:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788619782.074059:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788619782.074062:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788619782.074096:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.074105:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.074116:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.074136:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924416:0@lo:101: 00000100:00100000:2.0:1788619782.074192:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.074264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924416 00000100:00100000:2.0:1788619782.074266:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.074272:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924416 00000100:00100000:0.0:1788619782.074325:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788619782.074334:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676924416:12345-0@lo:101: 00010000:00010000:0.0:1788619782.074345:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619782.074356:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf16 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.074379:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.074389:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.074398:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031c00, rc 0) 00000100:00100000:0.0:1788619782.074450:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676924416:12345-0@lo:101: Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.074457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788619782.074713:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924416:0@lo:101: 00010000:00010000:2.0:1788619782.074735:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.074744:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619782.074879:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924544:0@lo:501: 00000100:00100000:3.0:1788619782.074910:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.074932:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.075263:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924544 00000100:00100000:0.0:1788619782.075269:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924544 00000100:00100000:2.0:1788619782.075330:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788619782.075339:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676924544:12345-0@lo:501: 00000100:00100000:2.0:1788619782.075574:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676924544:12345-0@lo:501: Request processed in 235us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.075581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788619782.075979:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924544:0@lo:501: 00000100:00100000:2.0:1788619782.076015:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924672:0@lo:503: 00000100:00100000:2.0:1788619782.076055:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.076304:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.076601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924672 00000100:00100000:0.0:1788619782.076607:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924672 00000100:00100000:0.0:1788619782.076667:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788619782.076675:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676924672:12345-0@lo:503: 00000100:00100000:0.0:1788619782.076850:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676924672:12345-0@lo:503: Request processed in 176us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.076858:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788619782.076924:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676924672:0@lo:503: 00000100:00100000:1.0:1788619782.077282:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6715:1875503676924800:0@lo:502: 00000100:00100000:1.0:1788619782.077320:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.077358:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426540 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.077399:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924800 00000100:00100000:2.0:1788619782.077403:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924800 00000100:00100000:2.0:1788619782.077432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788619782.077438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6715:x1875503676924800:12345-0@lo:502: 00000100:00100000:2.0:1788619782.077597:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6715:x1875503676924800:12345-0@lo:502: Request processed in 158us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.077604:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788619782.077729:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6715:1875503676924800:0@lo:502: 00000020:01000000:1.0:1788619782.077752:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788619782.077759:0:6715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788619782.077766:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.077768:0:6715:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788619782.077796:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788619782.077800:0:6715:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788619782.077820:0:6715:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788619782.077823:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788619782.077835:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9333a53acd40) 00000020:00000080:1.0:1788619782.077852:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788619782.077856:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788619782.077914:0:6715:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788619782.077919:0:6715:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788619782.077924:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbdf2b 00010000:00080000:1.0:1788619782.077961:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933284da3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788619782.078164:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 20000000:01000000:2.0:1788619782.080927:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788619782.080945:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788619782.081056:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788619782.081061:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788619782.081084:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.081103:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.081111:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.081150:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.081165:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 14 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619782.081179:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676924928:0@lo:104: 00000100:00100000:1.0:1788619782.081257:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.081315:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426240 going to sleep for 11 seconds 00000100:00100000:0.0:1788619782.081368:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676924928 00000100:00100000:0.0:1788619782.081376:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676924928 00000100:00100000:0.0:1788619782.081433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788619782.081443:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676924928:12345-0@lo:104: 00010000:00010000:0.0:1788619782.081460:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081527:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788619782.081533:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676924928:12345-0@lo:104: Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619782.081540:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788619782.081560:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619782.081565:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081573:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788619782.081577:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081585:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788619782.081592:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619782.081597:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788619782.081604:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676924928:0@lo:104: 00010000:00010000:0.0:1788619782.081617:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081623:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619782.081629:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081639:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081645:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813cf600/0xbb0e330328bbde6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbde75 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.081667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619782.081669:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619782.081670:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619782.081685:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676925056:0@lo:103: 00000100:00100000:0.0:1788619782.081716:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.081799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925056 00000100:00100000:2.0:1788619782.081803:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925056 00010000:00010000:2.0:1788619782.081822:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.081845:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788619782.081852:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93339086ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+15:3309:x1875503676925056:12345-0@lo:103: 00010000:00010000:2.0:1788619782.081862:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619782.081867:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081877:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081889:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbde75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbde6e expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081900:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081908:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788619782.081919:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001537506s 00010000:00010000:2.0:1788619782.081923:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081930:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081944:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081951:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081956:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619782.081961:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081968:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081980:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.081988:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619782.081999:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.082005:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.082010:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cf800/0xbb0e330328bbdf32 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.082046:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93339086ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+14:3309:x1875503676925056:12345-0@lo:103: Request processed in 195us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.082052:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788619782.082305:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676925056:0@lo:103: 00000040:01000000:3.0:1788619782.109696:0:6715:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788619782.109717:0:6715:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788619782.110185:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619782.110361:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619782.110412:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788619782.110599:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788619782.112462:0:6716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619782.112470:0:6716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788619782.113826:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788619782.113840:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788619782.113873:0:6715:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788619782.113892:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbdf39 00000100:00080000:1.0:1788619782.113902:0:6715:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788619782.113908:0:6715:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff933284da3000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788619782.113940:0:6715:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bd2fd500 x1875503676925184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788619782.113976:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788619782.114068:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619782.114072:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.114074:0:6715:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788619782.114077:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619782.114080:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.114082:0:6715:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788619782.114085:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788619782.114086:0:6715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788619782.114111:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6715:1875503676925312:0@lo:502: 00000100:00100000:1.0:1788619782.114180:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.114218:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788619782.114250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925312 00000100:00100000:1.0:1788619782.114256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925312 00000100:00100000:1.0:1788619782.114288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788619782.114296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:6715:x1875503676925312:12345-0@lo:502: 00000100:00100000:1.0:1788619782.114621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:6715:x1875503676925312:12345-0@lo:502: Request processed in 324us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619782.114640:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788619782.114685:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6715:1875503676925312:0@lo:502: 00000020:01000000:1.0:1788619782.114706:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619782.114710:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619782.114712:0:6715:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788619782.114715:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788619782.114842:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788619782.114858:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788619782.114867:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.114878:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619782.114888:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788619782.114891:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93338a7b5000 from 1 10000000:01000000:1.0:1788619782.114894:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619782.114918:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.114926:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619782.114935:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.115054:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676925184:0@lo:8: 00000100:00100000:2.0:1788619782.115094:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.115141:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925184 00000100:00100000:2.0:1788619782.115145:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925184 00000100:00100000:2.0:1788619782.115165:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619782.115170:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503676925184:12345-0@lo:8: 00000100:00100000:2.0:1788619782.115210:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503676925184:12345-0@lo:8: Request processed in 38us (114us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788619782.115216:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619782.115237:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788619782.115242:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284da3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788619782.115246:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788619782.115249:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676925184:0@lo:8: 00000100:00100000:1.0:1788619782.115299:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925440:0@lo:101: 00000100:00100000:1.0:1788619782.115326:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619782.115383:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.119826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925440 00000100:00100000:2.0:1788619782.119838:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925440 00000100:00100000:2.0:1788619782.119896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788619782.119906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676925440:12345-0@lo:101: 00010000:00010000:2.0:1788619782.119923:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619782.119939:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf40 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.119977:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.119989:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.119999:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:2.0:1788619782.120074:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676925440:12345-0@lo:101: Request processed in 168us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.120086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788619782.120179:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925440:0@lo:101: 00010000:00010000:0.0:1788619782.120197:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619782.120207:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619782.120267:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925568:0@lo:501: 00000100:00100000:0.0:1788619782.120297:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.120329:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933284918300 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.120443:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925568 00000100:00100000:2.0:1788619782.120447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925568 00000100:00100000:2.0:1788619782.120464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788619782.120470:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676925568:12345-0@lo:501: 00000100:00100000:2.0:1788619782.120730:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676925568:12345-0@lo:501: Request processed in 259us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.120738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788619782.120806:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925568:0@lo:501: 00000100:00100000:0.0:1788619782.120833:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925696:0@lo:503: 00000100:00100000:0.0:1788619782.120867:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619782.120892:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933284918300 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.122271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925696 00000100:00100000:2.0:1788619782.122281:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925696 00000100:00100000:2.0:1788619782.122312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788619782.122320:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676925696:12345-0@lo:503: 00000100:00100000:2.0:1788619782.122582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676925696:12345-0@lo:503: Request processed in 262us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.122590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788619782.122691:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676925696:0@lo:503: 00000100:00100000:3.0:1788619782.124181:0:6718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6718:1875503676925824:0@lo:502: 00000100:00100000:3.0:1788619782.124246:0:6718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.124283:0:6718:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338cd2d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.124408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925824 00000100:00100000:2.0:1788619782.124414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925824 00000100:00100000:2.0:1788619782.124455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788619782.124464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6718:x1875503676925824:12345-0@lo:502: 00000100:00100000:2.0:1788619782.124715:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6718:x1875503676925824:12345-0@lo:502: Request processed in 252us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.124722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788619782.124992:0:6718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6718:1875503676925824:0@lo:502: 00000020:01000000:3.0:1788619782.125020:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619782.125028:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619782.125031:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788619782.125045:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93338a7b5000 00000020:00000080:3.0:1788619782.125048:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788619782.125073:0:6718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6718:1875503676925952:0@lo:502: 00000100:00100000:3.0:1788619782.125107:0:6718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.125127:0:6718:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338cd2d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.125242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676925952 00000100:00100000:2.0:1788619782.125246:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676925952 00000100:00100000:2.0:1788619782.125266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788619782.125272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6718:x1875503676925952:12345-0@lo:502: 00000100:00100000:2.0:1788619782.125450:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:6718:x1875503676925952:12345-0@lo:502: Request processed in 177us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.125457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788619782.127069:0:6718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:6718:1875503676925952:0@lo:502: 00000020:01000000:3.0:1788619782.127103:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619782.127111:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619782.127113:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788619782.127118:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788619782.127172:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788619782.127189:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788619782.127199:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.127210:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619782.127219:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788619782.127221:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9333871319c0 from 1 10000000:01000000:3.0:1788619782.127224:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788619782.127254:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.127262:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619782.127272:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619782.127288:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676926080:0@lo:101: 00000100:00100000:3.0:1788619782.127345:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619782.127427:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338cd2d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.130715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926080 00000100:00100000:2.0:1788619782.130730:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926080 00000100:00100000:2.0:1788619782.130821:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788619782.130831:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676926080:12345-0@lo:101: 00010000:00010000:2.0:1788619782.130848:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619782.130866:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf4e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.130894:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.130907:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.130917:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:2.0:1788619782.131009:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676926080:12345-0@lo:101: Request processed in 179us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.131015:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788619782.131060:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676926080:0@lo:101: 00010000:00010000:2.0:1788619782.131076:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.131086:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.131167:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676926208:0@lo:501: 00000100:00100000:2.0:1788619782.131203:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619782.131227:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1788619782.131246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926208 00000100:00100000:2.0:1788619782.131250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926208 00000100:00100000:2.0:1788619782.131266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788619782.131272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676926208:12345-0@lo:501: 00000100:00100000:2.0:1788619782.131479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676926208:12345-0@lo:501: Request processed in 206us (275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788619782.131607:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788619782.131632:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676926208:0@lo:501: 10000000:01000000:2.0:1788619782.131653:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788619782.131660:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619782.131668:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619782.138471:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:6687:x1875503676923520:12345-0@lo:253: Request processed in 85809us (86529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619782.138492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788619782.138653:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:6687:1875503676923520:0@lo:253: 10000000:01000000:0.0:1788619782.138668:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788619782.138683:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788619782.138684:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788619782.138686:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788619782.138687:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788619782.138688:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788619782.138690:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788619782.138691:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788619782.138692:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788619782.138694:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788619782.138695:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788619782.138696:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788619782.138710:0:6687:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788619782.144279:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788619782.144767:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788619782.145129:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788619782.145275:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788619782.145560:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788619782.145835:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788619782.147098:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788619782.368391:0:6687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788619782.368398:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788619782.368440:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788619782.368605:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788619782.368619:0:6687:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788619782.368641:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788619782.600934:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619783.623331:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619784.647943:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619785.674343:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619786.695029:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788619787.463675:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788619787.463681:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676926336:0@lo:400: 00000100:00080000:1.0:1788619787.463683:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788619787.463689:0:496:0:(import.c:65:import_set_state_nolock()) ffff933284da3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788619787.463700:0:496:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff933284da3000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788619787.463722:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bd2fd180 x1875503676926720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788619787.463756:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619787.463759:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676926464:0@lo:400: 00000100:00100000:1.0:1788619787.463823:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619787.463852:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619787.463859:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676926592:0@lo:400: 00000100:00100000:1.0:1788619787.463940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619787.463990:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926464 00000100:00100000:1.0:1788619787.463997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926464 00000100:00100000:1.0:1788619787.464040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926592 00000100:00100000:0.0:1788619787.464060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788619787.464070:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676926464:12345-0@lo:400: 00000100:00100000:0.0:1788619787.464130:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676926464:12345-0@lo:400: Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619787.464138:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788619787.464157:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676926720:0@lo:8: 00010000:00080000:0.0:1788619787.464181:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fea00 x1875503676926464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619787.464196:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676926464:0@lo:400: 00000100:00100000:2.0:1788619787.464204:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619787.464241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926336 00000100:00100000:2.0:1788619787.464245:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926336 00000100:00100000:2.0:1788619787.464278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788619787.464285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503676926336:12345-0@lo:400: 00000100:00100000:2.0:1788619787.464320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503676926336:12345-0@lo:400: Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619787.464327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788619787.464370:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926720 00000100:00100000:2.0:1788619787.464374:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926720 00000100:00100000:2.0:1788619787.464403:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619787.464408:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875503676926720:12345-0@lo:8: 00010000:00080000:2.0:1788619787.464429:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788619787.464456:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbdf5c 00000100:00100000:0.0:1788619787.464471:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676926336:0@lo:400: 00002000:00100000:2.0:1788619787.464497:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9333bbf2a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788619787.464503:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788619787.464507:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788619787.464615:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788619787.464828:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788619787.464853:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9333bbf2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619787.464915:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503676926720:12345-0@lo:8: Request processed in 505us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619787.464922:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788619787.465090:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fd180 x1875503676926720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788619797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788619787.465103:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788619787.465110:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788619787.465114:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788619787.465116:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284da3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788619787.465129:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788619787.465134:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676926720:0@lo:8: 00000100:00100000:1.0:1788619787.465522:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926592 00000100:00080000:3.0:1788619787.465553:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619787.465570:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788619787.465577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676926592:12345-0@lo:400: 00000100:00100000:1.0:1788619787.465624:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676926592:12345-0@lo:400: Request processed in 47us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619787.465630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788619787.465648:0:6716:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788619787.466278:0:6716:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190434504727ns, next at 0ns, rc = 0 00010000:00080000:1.0:1788619787.466317:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fd500 x1875503676926592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619787.466337:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676926592:0@lo:400: 00000004:00080000:1.0:1788619787.542228:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788619787.545265:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676926848:0@lo:13: 00000100:00100000:3.0:1788619787.545346:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788619787.545441:0:6717:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788619787.545467:0:6717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676926976:0@lo:7: 00000100:00100000:0.0:1788619787.545494:0:6717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619787.545511:0:6717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98240 going to sleep for 11 seconds 00000100:00100000:0.0:1788619787.545545:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926976 00000100:00100000:0.0:1788619787.545551:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926976 00000100:00100000:0.0:1788619787.545604:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788619787.545613:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1875503676926976:12345-0@lo:7: 00000100:00100000:3.0:1788619787.553820:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676926848 00000100:00100000:3.0:1788619787.553832:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676926848 00000100:00100000:3.0:1788619787.553881:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788619787.553961:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503676926848:12345-0@lo:13: 00002000:00000024:3.0:1788619787.553993:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788619787.556040:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503676926848:12345-0@lo:13: Request processed in 2143us (10686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619787.556138:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788619787.556220:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333909daa00 x1875503676926848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619787.556244:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676926848:0@lo:13: 00000100:00080000:3.0:1788619787.556973:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788619787.562887:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788619787.566003:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788619787.566119:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1875503676926976:12345-0@lo:7: Request processed in 20501us (20617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619787.566129:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788619787.566428:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333909d9880 x1875503676926976/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788619803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619787.566442:0:6717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676926976:0@lo:7: 00000004:00080000:1.0:1788619787.566457:0:6717:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788619787.566496:0:6717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927104:0@lo:5: 00000100:00100000:1.0:1788619787.566532:0:6717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619787.566574:0:6717:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e61f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619787.566595:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927104 00000100:00100000:1.0:1788619787.566601:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927104 00000100:00100000:1.0:1788619787.566641:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619787.566648:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6717:x1875503676927104:12345-0@lo:5: 00002000:00080000:1.0:1788619787.566670:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788619787.566673:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788619787.567025:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6717:x1875503676927104:12345-0@lo:5: Request processed in 375us (491us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788619787.567032:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788619787.567438:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fd500 x1875503676927104/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619787.567452:0:6717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927104:0@lo:5: 00000004:00080000:1.0:1788619787.567463:0:6717:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788619787.567489:0:6717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927232:0@lo:700: 00000100:00100000:1.0:1788619787.567520:0:6717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619787.567558:0:6717:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619787.568905:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927232 00000100:00100000:3.0:1788619787.568916:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927232 00000100:00100000:3.0:1788619787.568972:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788619787.568982:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6717:x1875503676927232:12345-0@lo:700: 00000100:00100000:3.0:1788619787.569030:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1875503676927360:0@lo:700: 00000100:00100000:3.0:1788619787.569253:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619787.569285:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619787.569333:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927360 00000100:00100000:1.0:1788619787.569338:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927360 00000100:00100000:1.0:1788619787.569379:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619787.569395:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1875503676927360:12345-0@lo:700: 40000000:02000000:2.0:1788619787.625469:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788619787.633845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1875503676927360:12345-0@lo:700: Request processed in 64442us (64583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619787.633873:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788619787.638611:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93338715c380 x1875503676927360/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788619803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619787.638631:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1875503676927360:0@lo:700: 40000000:02000000:0.0:1788619787.638646:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:0.0:1788619787.721603:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619787.722991:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6717:x1875503676927232:12345-0@lo:700: Request processed in 154003us (155462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619787.723004:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788619787.723066:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2ff480 x1875503676927232/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788619803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619787.723082:0:6717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927232:0@lo:700: 00000001:00080000:2.0:1788619787.723609:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788619787.723621:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1788619787.757419:0:6717:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788619787.761044:0:6717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927488:0@lo:5: 00000100:00100000:3.0:1788619787.761108:0:6717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619787.761197:0:6717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31840 going to sleep for 11 seconds 00000100:00100000:1.0:1788619787.761237:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927488 00000100:00100000:1.0:1788619787.761245:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927488 00000100:00100000:1.0:1788619787.761323:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788619787.761332:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6717:x1875503676927488:12345-0@lo:5: 00002000:00080000:1.0:1788619787.766179:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788619787.766199:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788619787.772392:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1875503676927488:12345-0@lo:5: Request processed in 11043us (11265us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788619787.772404:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788619787.772500:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93338715df80 x1875503676927488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619787.772514:0:6717:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788619787.772532:0:6717:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93338715df80 x1875503676927488/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619803 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619787.772542:0:6717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875503676927488:0@lo:5: 00000004:00080000:3.0:1788619787.772556:0:6717:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:1.0:1788619788.358060:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788619788.743032:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619789.770144:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788619790.022899:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788619790.022907:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93338a7b5000 from 4 10000000:01000000:2.0:1788619790.022913:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788619790.022963:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619790.022976:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619790.022987:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619790.023010:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676927616:0@lo:101: 00000100:00100000:2.0:1788619790.023092:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619790.023208:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619790.026800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927616 00000100:00100000:0.0:1788619790.026815:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927616 00000100:00100000:0.0:1788619790.027423:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788619790.027435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676927616:12345-0@lo:101: 00010000:00010000:0.0:1788619790.027452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619790.027482:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf63 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619790.027999:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619790.028013:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619790.028023:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030e00, rc 0) 00000100:00100000:0.0:1788619790.028116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676927616:12345-0@lo:101: Request processed in 683us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619790.028123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788619790.034400:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676927616:0@lo:101: 00010000:00010000:3.0:1788619790.034431:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619790.034443:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619790.034548:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676927744:0@lo:256: 00000100:00100000:3.0:1788619790.034617:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619790.034664:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619790.034856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927744 00000100:00100000:0.0:1788619790.034863:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927744 00000100:00100000:0.0:1788619790.034907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788619790.034916:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676927744:12345-0@lo:256: 20000000:01000000:0.0:1788619790.034934:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788619790.034951:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788619790.034955:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788619790.035053:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676927744:12345-0@lo:256: Request processed in 138us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619790.035061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788619790.035414:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676927744:0@lo:256: 10000000:01000000:3.0:1788619790.035521:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788619790.035529:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619790.035539:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619790.791048:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619791.815868:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619792.585469:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788619792.585495:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676927872:0@lo:13: 00000100:00100000:3.0:1788619792.585558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619792.585615:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676927872 00000100:00100000:3.0:1788619792.585622:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676927872 00000100:00100000:3.0:1788619792.585668:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788619792.585676:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875503676927872:12345-0@lo:13: 00002000:00000024:3.0:1788619792.585711:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619792.585753:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875503676927872:12345-0@lo:13: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619792.585761:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788619792.585797:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788619792.585827:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93338715dc00 x1875503676927872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619792.585846:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676927872:0@lo:13: 00000100:00100000:0.0:1788619792.587093:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676928128:0@lo:400: 00000100:00100000:0.0:1788619792.587151:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619792.587178:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788619792.587184:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676928000:0@lo:400: 00000100:00100000:0.0:1788619792.587236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619792.587273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928128 00000100:00100000:0.0:1788619792.587279:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928128 00000100:00100000:0.0:1788619792.587314:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788619792.587322:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676928128:12345-0@lo:400: 00000100:00100000:0.0:1788619792.587374:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676928128:12345-0@lo:400: Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619792.587380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788619792.587397:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928000 00000100:00100000:0.0:1788619792.587401:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928000 00000100:00100000:0.0:1788619792.587434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619792.587440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3312:x1875503676928000:12345-0@lo:400: 00000100:00100000:0.0:1788619792.587465:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3312:x1875503676928000:12345-0@lo:400: Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619792.587472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619792.587500:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619792.587509:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676928256:0@lo:400: 00000100:00100000:0.0:1788619792.587532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619792.587556:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928256 00000100:00100000:0.0:1788619792.587560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928256 00000100:00100000:0.0:1788619792.587589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788619792.587595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676928256:12345-0@lo:400: 00000100:00100000:0.0:1788619792.587626:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676928256:12345-0@lo:400: Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619792.587641:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788619792.587672:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333909d9180 x1875503676928256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619792.587684:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676928256:0@lo:400: 00000100:00100000:0.0:1788619792.587708:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676928000:0@lo:400: 00010000:00080000:0.0:1788619792.587717:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333909db100 x1875503676928128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619792.587724:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676928128:0@lo:400: 00000100:00080000:3.0:1788619792.588643:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788619792.838969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788619793.148407:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788619793.862891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619794.888219:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619795.911853:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619796.938793:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619797.704323:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676928384:0@lo:13: 00000100:00100000:3.0:1788619797.704404:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619797.704490:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928384 00000100:00100000:3.0:1788619797.704497:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928384 00000100:00100000:3.0:1788619797.704560:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788619797.704570:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676928384:12345-0@lo:13: 00002000:00000024:3.0:1788619797.704604:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619797.704648:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676928384:12345-0@lo:13: Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619797.704656:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788619797.704682:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788619797.704713:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93338715dc00 x1875503676928384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619797.704724:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788619797.704743:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676928384:0@lo:13: 00000100:00100000:3.0:1788619797.706716:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676928512:0@lo:400: 00000100:00100000:1.0:1788619797.706743:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676928768:0@lo:400: 00000100:00100000:2.0:1788619797.706799:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676928640:0@lo:400: 00000100:00100000:1.0:1788619797.712468:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619797.712569:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928768 00000100:00100000:1.0:1788619797.712578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928768 00000100:00100000:1.0:1788619797.712637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619797.712649:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676928768:12345-0@lo:400: 00000100:00100000:1.0:1788619797.712730:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676928768:12345-0@lo:400: Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619797.712737:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788619797.712762:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788619797.712807:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fc700 x1875503676928768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619797.712830:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676928768:0@lo:400: 00000100:00100000:3.0:1788619797.713729:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619797.718710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619797.719167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928512 00000100:00100000:1.0:1788619797.719177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928512 00000100:00100000:1.0:1788619797.719252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788619797.719261:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:3311:x1875503676928512:12345-0@lo:400: 00000100:00100000:1.0:1788619797.719337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:3311:x1875503676928512:12345-0@lo:400: Request processed in 77us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619797.719344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788619797.719394:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676928512:0@lo:400: 00000100:00100000:1.0:1788619797.725363:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928640 00000100:00100000:1.0:1788619797.725377:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928640 00000100:00100000:1.0:1788619797.725430:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788619797.725439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676928640:12345-0@lo:400: 00000100:00100000:1.0:1788619797.725643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676928640:12345-0@lo:400: Request processed in 203us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619797.725650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788619797.725729:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd2fd880 x1875503676928640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619797.725743:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676928640:0@lo:400: 00010000:00010000:3.0:1788619797.961937:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619798.986878:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788619799.756712:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788619799.756722:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788619799.757384:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9333861ca800 00000020:01000004:3.0:1788619799.757534:0:7628:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788619799.757548:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788619799.757561:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9333bd343380) 00000020:00000080:3.0:1788619799.757577:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788619799.780133:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788619799.780411:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788619799.814221:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788619799.822020:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788619799.822087:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788619799.822151:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788619799.822176:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788619799.823461:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788619799.823474:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788619799.823484:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbdf78 00000020:01000004:2.0:1788619799.823493:0:7628:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788619799.823513:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788619799.823516:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788619799.823521:0:7628:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788619799.823543:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788619799.823548:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788619799.851081:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788619799.851120:0:7628:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788619799.851125:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788619799.851126:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788619799.851128:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619799.851129:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788619799.851130:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619799.851132:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619799.851133:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788619799.851135:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788619799.851136:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788619799.851138:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619799.851139:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788619799.851142:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788619799.851145:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788619799.851146:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788619799.851147:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619799.851149:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788619799.851150:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619799.851151:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619799.851157:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788619799.851158:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788619799.851159:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788619799.851160:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619799.851161:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788619799.851187:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788619799.851207:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676928896:0@lo:253: 00000100:00100000:2.0:1788619799.851367:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.851472:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619799.851582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676928896 00000100:00100000:0.0:1788619799.851591:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676928896 00000100:00100000:0.0:1788619799.851689:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788619799.851700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:7628:x1875503676928896:12345-0@lo:253: 20000000:01000000:0.0:1788619799.851731:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788619799.851735:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788619799.851751:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788619799.851755:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788619799.853214:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788619799.853660:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788619799.853674:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788619799.853717:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788619799.853726:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788619799.854257:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788619799.854508:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788619799.855133:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788619799.855154:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:0.0:1788619799.855162:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:0.0:1788619799.855201:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788619799.855209:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788619799.855262:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788619799.855269:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:0.0:1788619799.855383:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788619799.855394:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788619799.855691:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788619799.856124:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788619799.857267:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788619799.857364:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:0.0:1788619799.857367:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:0.0:1788619799.857405:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788619799.857498:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788619799.857538:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788619799.857546:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:0.0:1788619799.857688:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788619799.857699:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788619799.857861:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788619799.857904:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788619799.858017:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788619799.858021:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788619799.858028:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788619799.858029:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788619799.858031:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788619799.858044:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788619799.858047:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788619799.858082:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788619799.858084:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788619799.859004:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788619799.859103:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788619799.859138:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788619799.859844:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788619799.859902:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788619799.859962:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788619799.859980:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788619799.859982:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788619799.861727:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788619799.861977:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788619799.862145:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788619799.867766:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788619799.869436:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788619799.869535:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788619799.869568:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788619799.869571:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788619799.872840:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788619799.873193:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788619799.873254:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788619799.873616:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788619799.873678:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788619799.873735:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788619799.873751:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788619799.873754:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788619799.875105:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788619799.875679:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788619799.875725:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788619799.876083:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1788619799.876106:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788619799.876125:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876143:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876152:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876159:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876165:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876171:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876179:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876217:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876249:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.876264:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929024:0@lo:104: 00000100:00100000:0.0:1788619799.876346:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788619799.876392:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876412:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.876421:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929152:0@lo:104: 00010000:00010000:0.0:1788619799.876445:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876527:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.876535:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929280:0@lo:104: 00010000:00010000:0.0:1788619799.876562:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876570:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.876577:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929408:0@lo:104: 00010000:00010000:0.0:1788619799.876598:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.876617:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.876626:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929536:0@lo:104: 00000100:00100000:0.0:1788619799.876753:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90240 going to sleep for 11 seconds 00000100:00100000:1.0:1788619799.877578:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788619799.877606:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.877633:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.877707:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.877718:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.877728:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929024 00000100:00100000:1.0:1788619799.877734:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929024 00000100:00100000:1.0:1788619799.877767:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929152 00000100:00100000:1.0:1788619799.877787:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929152 00000100:00100000:1.0:1788619799.877799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929280 00000100:00100000:1.0:1788619799.877801:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929280 00000100:00100000:1.0:1788619799.877809:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929408 00000100:00100000:1.0:1788619799.877811:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929408 00000100:00100000:1.0:1788619799.877818:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929536 00000100:00100000:1.0:1788619799.877820:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929536 00000100:00100000:0.0:1788619799.878757:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788619799.878784:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93339034a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+7:5834:x1875503676929024:12345-0@lo:104: 00010000:00010000:0.0:1788619799.878802:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.879797:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619799.879808:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93339034a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+7:5834:x1875503676929024:12345-0@lo:104: Request processed in 1039us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619799.879816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788619799.879894:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619799.879904:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619799.879947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619799.879958:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+6:5834:x1875503676929152:12345-0@lo:104: 00010000:00010000:1.0:1788619799.879970:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880001:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619799.880005:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880014:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619799.880021:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619799.880026:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788619799.880060:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880066:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619799.880086:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880093:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdf4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880107:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619799.880109:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880114:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ea000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619799.880117:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880132:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619799.880138:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619799.880143:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788619799.880156:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880161:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619799.880177:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880183:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ea000/0xbb0e330328bbdf16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf1d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880192:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619799.880194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619799.880195:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619799.880204:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929024:0@lo:104: 00000100:00100000:0.0:1788619799.880213:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929152:0@lo:104: 00000100:00100000:3.0:1788619799.880217:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676929664:0@lo:103: 00000100:00100000:3.0:1788619799.880255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788619799.880311:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619799.880318:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+6:5834:x1875503676929152:12345-0@lo:104: Request processed in 364us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.880322:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676929792:0@lo:103: 00000100:00100000:1.0:1788619799.880330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619799.880343:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788619799.880344:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.880350:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:5834:x1875503676929280:12345-0@lo:104: 00010000:00010000:1.0:1788619799.880358:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619799.880377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929664 00000100:00100000:3.0:1788619799.880383:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929664 00010000:00010000:1.0:1788619799.880393:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619799.880397:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:5834:x1875503676929280:12345-0@lo:104: Request processed in 49us (2763us total) trans 0 rc 0/0 00010000:00010000:3.0:1788619799.880403:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 17 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619799.880437:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929792 00000100:00100000:3.0:1788619799.880441:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929792 00010000:00010000:3.0:1788619799.880454:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 18 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619799.880466:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788619799.880471:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+18:3310:x1875503676929664:12345-0@lo:103: 00010000:00010000:3.0:1788619799.880480:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619799.880485:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 18 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880495:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 18 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880509:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbdf55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf4e expref: 18 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880522:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619799.880549:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+17:3310:x1875503676929664:12345-0@lo:103: Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.880555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788619799.880567:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788619799.880573:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+16:3311:x1875503676929792:12345-0@lo:103: 00010000:00010000:3.0:1788619799.880579:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619799.880583:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880591:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880605:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031c00/0xbb0e330328bbdf1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf16 expref: 16 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880614:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619799.880639:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+15:3311:x1875503676929792:12345-0@lo:103: Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.880645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788619799.880661:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619799.880665:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880671:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ea600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619799.880674:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880681:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619799.880687:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619799.880693:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788619799.880711:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880717:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619799.880725:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.880731:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ea600/0xbb0e330328bbdf08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619799.880992:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788619799.881009:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788619799.881293:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676929792:0@lo:103: 00000100:00100000:2.0:1788619799.881322:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619799.881329:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676929920:0@lo:103: 00000100:00100000:2.0:1788619799.881361:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.881522:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:5834:x1875503676929408:12345-0@lo:104: 00000100:00100000:0.0:1788619799.881527:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676929920 00000100:00100000:0.0:1788619799.881532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676929920 00010000:00010000:1.0:1788619799.881535:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.881550:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.881569:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788619799.881570:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788619799.881573:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:5834:x1875503676929408:12345-0@lo:104: Request processed in 560us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.881576:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+15:3311:x1875503676929920:12345-0@lo:103: 00000100:00100000:1.0:1788619799.881580:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788619799.881583:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619799.881587:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619799.881592:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788619799.881595:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619799.881598:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676929536:12345-0@lo:104: 00010000:00010000:1.0:1788619799.881605:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.881608:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619799.881630:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788619799.881635:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:5834:x1875503676929536:12345-0@lo:104: Request processed in 38us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.881635:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+15:3311:x1875503676929920:12345-0@lo:103: Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.881641:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788619799.881688:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676929920:0@lo:103: 00000100:00100000:2.0:1788619799.881712:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676929664:0@lo:103: 00000100:00100000:1.0:1788619799.881824:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788619799.881852:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788619799.881962:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031600/0xbb0e330328bbdf0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf08 expref: 14 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619799.881973:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929280:0@lo:104: 00000100:00100000:0.0:1788619799.881981:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929408:0@lo:104: 00000100:00100000:0.0:1788619799.881987:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1875503676929536:0@lo:104: 00010000:00010000:0.0:1788619799.882007:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.882209:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619799.882241:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.882249:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619799.882253:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.882262:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619799.882269:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619799.882274:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619799.882314:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.882322:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619799.882338:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.882346:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbdee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdeec expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.882358:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619799.882359:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619799.882361:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619799.882366:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788619799.882383:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676930048:0@lo:103: 00010000:00010000:3.0:1788619799.882419:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619799.882421:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619799.882422:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619799.882501:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619799.882504:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619799.882506:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619799.882538:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.882546:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ea200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788619799.882549:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.882556:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788619799.882562:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619799.882567:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788619799.882621:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.882627:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788619799.882994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.883033:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676930176:0@lo:103: 00000100:00100000:1.0:1788619799.883057:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.883097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930048 00000100:00100000:3.0:1788619799.883098:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930176 00000100:00100000:3.0:1788619799.883102:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930176 00000100:00100000:1.0:1788619799.883102:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930048 00010000:00010000:3.0:1788619799.883123:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.883123:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.883200:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.883208:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ea200/0xbb0e330328bbdebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdec2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.883225:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619799.883227:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619799.883229:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619799.883293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788619799.883312:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503676930176:12345-0@lo:103: 00010000:00010000:3.0:1788619799.883323:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619799.883328:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883337:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883349:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030c00/0xbb0e330328bbdec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdebb expref: 15 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883360:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619799.883412:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788619799.883420:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788619799.883431:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+14:3310:x1875503676930176:12345-0@lo:103: Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.883438:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788619799.883453:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788619799.883459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+13:3310:x1875503676930048:12345-0@lo:103: 00010000:00010000:3.0:1788619799.883468:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619799.883482:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 13 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883499:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 13 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883510:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6ea800/0xbb0e330328bbdeec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdee5 expref: 13 pid: 5833 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883520:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883528:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883541:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883548:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883554:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883560:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883565:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380031e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788619799.883569:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883577:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883602:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883611:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619799.883635:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+12:3310:x1875503676930048:12345-0@lo:103: Request processed in 176us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.883641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788619799.883660:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883667:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619799.883674:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031e00/0xbb0e330328bbdf7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788619799.883687:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788619799.889311:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676930176:0@lo:103: 00000100:00100000:0.0:1788619799.889329:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676930048:0@lo:103: 00000100:00100000:0.0:1788619799.964191:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+11:7628:x1875503676928896:12345-0@lo:253: Request processed in 112485us (112816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.964204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788619799.964361:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676928896:0@lo:253: 10000000:01000000:2.0:1788619799.964375:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788619799.964379:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788619799.964380:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788619799.964381:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788619799.964383:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788619799.964384:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788619799.964385:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788619799.964387:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788619799.964388:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788619799.964390:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788619799.964391:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788619799.964626:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9333861ca800 from lustre-OST0001 10000000:01000000:2.0:1788619799.964649:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788619799.964652:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788619799.964659:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9333871319c0 local copy 10000000:01000000:2.0:1788619799.964663:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788619799.964694:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.964705:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.964714:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619799.964730:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930304:0@lo:101: 00000100:00100000:2.0:1788619799.964763:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.964870:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619799.965181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930304 00000100:00100000:1.0:1788619799.965187:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930304 00000100:00100000:1.0:1788619799.965256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788619799.965264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+11:7628:x1875503676930304:12345-0@lo:101: 00010000:00010000:1.0:1788619799.965275:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619799.965288:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbdf8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf86 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.965322:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbdf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf86 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.965332:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbdf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf86 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.965340:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfc00, rc 0) 00000100:00100000:1.0:1788619799.965383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930304:12345-0@lo:101: Request processed in 120us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619799.965390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788619799.965474:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930304:0@lo:101: 00010000:00010000:2.0:1788619799.965488:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.965496:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619799.965988:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930432:0@lo:501: 00000100:00100000:2.0:1788619799.966025:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.966383:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619799.966722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930432 00000100:00100000:0.0:1788619799.966729:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930432 00000100:00100000:0.0:1788619799.966760:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788619799.966768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930432:12345-0@lo:501: 00000100:00100000:0.0:1788619799.967015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930432:12345-0@lo:501: Request processed in 247us (989us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788619799.967023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788619799.967232:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930432:0@lo:501: 10000000:01000000:2.0:1788619799.967251:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788619799.967284:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788619799.967290:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.967359:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.967367:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.967388:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788619799.967418:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9333861ca800 10000000:01000000:2.0:1788619799.967422:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788619799.967427:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788619799.967429:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788619799.967433:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788619799.967436:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788619799.967632:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.967640:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.967649:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619799.967663:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930560:0@lo:101: 00000100:00100000:2.0:1788619799.967692:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.967721:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619799.967798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930560 00000100:00100000:0.0:1788619799.967802:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930560 00000100:00100000:0.0:1788619799.967837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788619799.967844:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930560:12345-0@lo:101: 00010000:00010000:0.0:1788619799.967852:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619799.967864:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdf94 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.967984:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.967996:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619799.968004:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031600, rc 0) 00000100:00100000:0.0:1788619799.968031:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676930560:12345-0@lo:101: Request processed in 188us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.968036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1788619799.968097:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619799.968108:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968115:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619799.968118:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968126:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619799.968133:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619799.968138:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619799.968155:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968160:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619799.968187:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968193:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eb800/0xbb0e330328bbdf86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb0e330328bbdf8d expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968205:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619799.968206:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619799.968208:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619799.968214:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619799.968224:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676930688:0@lo:103: 00000100:00100000:1.0:1788619799.968250:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.968280:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930688 00000100:00100000:1.0:1788619799.968289:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930688 00000100:00100000:1.0:1788619799.968474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788619799.968481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+13:3312:x1875503676930688:12345-0@lo:103: 00010000:00010000:1.0:1788619799.968489:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619799.968498:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbdf8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbdf86 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619799.968507:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619799.968531:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+12:3312:x1875503676930688:12345-0@lo:103: Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619799.968537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619799.968603:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930560:0@lo:101: 00010000:00010000:2.0:1788619799.968619:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619799.968628:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619799.968696:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930816:0@lo:501: 00000100:00100000:2.0:1788619799.968718:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.968730:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619799.969056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930816 00000100:00100000:3.0:1788619799.969060:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930816 00000100:00100000:3.0:1788619799.969084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788619799.969089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930816:12345-0@lo:501: 00000100:00100000:3.0:1788619799.969270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930816:12345-0@lo:501: Request processed in 180us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.969277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788619799.969520:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930816:0@lo:501: 00000100:00100000:2.0:1788619799.969549:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930944:0@lo:503: 00000100:00100000:2.0:1788619799.969637:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.969663:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619799.969992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676930944 00000100:00100000:2.0:1788619799.969997:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676930944 00000100:00100000:2.0:1788619799.970026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788619799.970032:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930944:12345-0@lo:503: 00000100:00100000:2.0:1788619799.970186:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676930944:12345-0@lo:503: Request processed in 154us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619799.970193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788619799.970237:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676930944:0@lo:503: 00000100:00100000:0.0:1788619799.970975:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676930688:0@lo:103: 00000040:00080000:2.0:1788619799.971256:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788619799.971701:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931072:0@lo:502: 00000100:00100000:2.0:1788619799.971760:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619799.972027:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619799.972074:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931072 00000100:00100000:0.0:1788619799.972080:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931072 00000100:00100000:0.0:1788619799.972117:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788619799.972125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676931072:12345-0@lo:502: 00000100:00100000:0.0:1788619799.972674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676931072:12345-0@lo:502: Request processed in 548us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619799.972683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788619799.972759:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931072:0@lo:502: 00000040:00080000:0.0:1788619799.974152:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788619799.974223:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788619799.974255:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788619799.974381:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788619799.979097:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788619799.979159:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788619799.979206:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931200:0@lo:502: 00000100:00100000:0.0:1788619799.979290:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619799.980240:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619799.980280:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931200 00000100:00100000:3.0:1788619799.980289:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931200 00000100:00100000:3.0:1788619799.980695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788619799.980716:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676931200:12345-0@lo:502: 00000100:00100000:3.0:1788619799.981000:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676931200:12345-0@lo:502: Request processed in 286us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619799.981008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788619799.981172:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931200:0@lo:502: 00000040:00080000:1.0:1788619799.981334:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788619799.981349:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788619799.982503:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788619799.982514:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788619799.982521:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619799.982523:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788619799.982528:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788619799.982542:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9333a53a99c0) 00000020:00000080:1.0:1788619799.982579:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788619799.982587:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788619799.982661:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333861ca800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788619799.982670:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788619799.982676:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbdfa9 00010000:00010000:1.0:1788619799.988996:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788619799.989668:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788619799.994267:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788619799.994731:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788619800.000825:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788619800.002080:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788619800.003416:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788619800.003429:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619800.003437:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619800.003439:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788619800.003442:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619800.003445:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619800.004650:0:7638:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788619800.004663:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788619800.004665:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788619800.004719:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619800.004722:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619800.004724:0:7638:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788619800.004727:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788619800.006700:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788619800.006743:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788619800.006840:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619800.006853:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619800.007202:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333861ca800 from 1 10000000:01000000:1.0:1788619800.007206:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619800.007242:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619800.007250:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619800.007260:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619800.007282:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931328:0@lo:101: 00000100:00100000:1.0:1788619800.007364:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619800.007663:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc58da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.007704:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931328 00000100:00100000:0.0:1788619800.007712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931328 00010000:00010000:3.0:1788619800.009858:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619800.011262:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788619800.011288:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+12:7628:x1875503676931328:12345-0@lo:101: 00010000:00010000:2.0:1788619800.011314:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619800.011334:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdfb0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.011361:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.011372:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.011381:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eae00, rc 0) 00000100:00100000:2.0:1788619800.011867:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931328:12345-0@lo:101: Request processed in 582us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.011981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788619800.012095:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931328:0@lo:101: 00010000:00010000:0.0:1788619800.012114:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619800.012123:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619800.012228:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931456:0@lo:501: 00000100:00100000:0.0:1788619800.012265:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619800.012312:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392fdd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788619800.012360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931456 00000100:00100000:2.0:1788619800.012366:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931456 00000100:00100000:2.0:1788619800.012410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788619800.012417:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931456:12345-0@lo:501: 00000100:00100000:2.0:1788619800.012837:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931456:12345-0@lo:501: Request processed in 410us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.012845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788619800.012984:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931456:0@lo:501: 00000100:00100000:2.0:1788619800.013016:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931584:0@lo:503: 00000100:00100000:2.0:1788619800.013054:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.013074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931584 00000100:00100000:2.0:1788619800.013077:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931584 00000100:00100000:2.0:1788619800.013094:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788619800.013104:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931584:12345-0@lo:503: 00000100:00100000:2.0:1788619800.013391:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931584:12345-0@lo:503: Request processed in 285us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.013398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788619800.013439:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619800.013675:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931584:0@lo:503: 00000040:00080000:2.0:1788619800.014122:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788619800.014189:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931712:0@lo:502: 00000100:00100000:2.0:1788619800.014232:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.014271:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.014408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931712 00000100:00100000:0.0:1788619800.014413:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931712 00000100:00100000:0.0:1788619800.014455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788619800.014462:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931712:12345-0@lo:502: 00000100:00100000:0.0:1788619800.014940:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931712:12345-0@lo:502: Request processed in 409us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619800.014950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788619800.015112:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931712:0@lo:502: 00000040:00080000:2.0:1788619800.015390:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788619800.015658:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788619800.015687:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931840:0@lo:502: 00000100:00100000:2.0:1788619800.015731:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.015849:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.016020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931840 00000100:00100000:0.0:1788619800.016025:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931840 00000100:00100000:0.0:1788619800.016088:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788619800.016102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931840:12345-0@lo:502: 00000100:00100000:0.0:1788619800.016247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931840:12345-0@lo:502: Request processed in 147us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619800.016255:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788619800.016328:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931840:0@lo:502: 00000040:00080000:2.0:1788619800.016418:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788619800.016428:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788619800.017158:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619800.017168:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619800.017170:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788619800.017185:0:7642:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333861ca800 00000020:00000080:1.0:1788619800.017188:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788619800.017214:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619800.017218:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619800.017219:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788619800.017222:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788619800.018085:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788619800.018111:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788619800.018132:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.018144:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619800.018195:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788619800.018198:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9333861ca800 10000000:01000000:2.0:1788619800.018201:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9333861ca800 10000000:01000000:2.0:1788619800.018205:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788619800.018210:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333861ca800 from 1 10000000:01000000:2.0:1788619800.018213:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788619800.018244:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.018252:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.018263:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619800.018283:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931968:0@lo:101: 00000100:00100000:2.0:1788619800.018348:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.018389:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.021664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676931968 00000100:00100000:0.0:1788619800.021679:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676931968 00000100:00100000:0.0:1788619800.021742:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788619800.021751:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676931968:12345-0@lo:101: 00010000:00010000:0.0:1788619800.021766:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619800.021809:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdfbe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619800.022976:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619800.022993:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619800.023003:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031000, rc 0) 00000100:00100000:1.0:1788619800.023076:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676931968:12345-0@lo:101: Request processed in 1327us (4728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.023083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788619800.025472:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676931968:0@lo:101: 00010000:00010000:3.0:1788619800.025497:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619800.025508:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619800.025625:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932096:0@lo:501: 00000100:00100000:3.0:1788619800.025678:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619800.025719:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619800.026100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932096 00000100:00100000:1.0:1788619800.026107:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932096 00000100:00100000:1.0:1788619800.026147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788619800.026155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932096:12345-0@lo:501: 00000100:00100000:1.0:1788619800.026422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932096:12345-0@lo:501: Request processed in 267us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.026429:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788619800.026539:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932096:0@lo:501: 00000100:00100000:3.0:1788619800.026569:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932224:0@lo:503: 00000100:00100000:3.0:1788619800.026608:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619800.026637:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619800.026821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932224 00000100:00100000:1.0:1788619800.026825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932224 00000100:00100000:1.0:1788619800.026850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788619800.026856:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932224:12345-0@lo:503: 00000100:00100000:1.0:1788619800.027015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932224:12345-0@lo:503: Request processed in 158us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.027031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788619800.027974:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932224:0@lo:503: 00000040:00080000:2.0:1788619800.028262:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788619800.028334:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932352:0@lo:502: 00000100:00100000:2.0:1788619800.028383:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.028472:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387f6eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788619800.033645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932352 00000100:00100000:1.0:1788619800.033659:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932352 00000100:00100000:1.0:1788619800.034379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788619800.034392:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932352:12345-0@lo:502: 00000100:00100000:1.0:1788619800.034907:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932352:12345-0@lo:502: Request processed in 516us (6522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.034916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788619800.035131:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932352:0@lo:502: 00000040:00080000:2.0:1788619800.035465:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788619800.035524:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788619800.035728:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788619800.035824:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788619800.035876:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788619800.035928:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788619800.035965:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788619800.036000:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788619800.036044:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788619800.036079:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788619800.036109:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788619800.036151:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788619800.036198:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788619800.036229:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788619800.036273:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788619800.036320:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788619800.036355:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788619800.036633:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788619800.036678:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788619800.036713:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788619800.036765:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788619800.036936:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788619800.036977:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788619800.037028:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788619800.037063:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788619800.037096:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788619800.037141:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788619800.037175:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788619800.037224:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788619800.037269:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788619800.037313:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788619800.037346:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788619800.037376:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788619800.037682:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788619800.037726:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788619800.037926:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788619800.037977:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788619800.038025:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932480:0@lo:502: 00000100:00100000:2.0:1788619800.038101:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.038184:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf4126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619800.038264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932480 00000100:00100000:1.0:1788619800.038271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932480 00000100:00100000:1.0:1788619800.038334:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788619800.038343:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932480:12345-0@lo:502: 00000100:00100000:1.0:1788619800.038686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676932480:12345-0@lo:502: Request processed in 343us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.038694:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788619800.038796:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676932480:0@lo:502: 00000040:00080000:1.0:1788619800.038884:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788619800.038895:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788619800.039668:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788619800.039682:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9332849c8000) 00000020:00000080:2.0:1788619800.039703:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788619800.039987:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333861ca800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788619800.039991:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333861ca800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788619800.039994:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333861ca800 3 00010000:00080000:2.0:1788619800.040024:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933284eb7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788619800.041560:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788619800.041746:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788619800.041801:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788619800.041824:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb0e330328bbdfd3 00000100:00080000:2.0:1788619800.041833:0:7643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788619800.041839:0:7643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933284eb7000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788619800.041870:0:7643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333b94fed80 x1875503676932608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788619800.041896:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788619800.041987:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676932864:0@lo:400: 00000100:00100000:2.0:1788619800.042052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.042081:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619800.042087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676932992:0@lo:400: 00000100:00100000:2.0:1788619800.042109:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.042142:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932992 00000100:00100000:2.0:1788619800.042148:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932992 00000100:00100000:2.0:1788619800.042199:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619800.042212:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676932992:12345-0@lo:400: 00000100:00100000:2.0:1788619800.042258:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676932992:12345-0@lo:400: Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.042265:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788619800.042281:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619800.042290:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676932736:0@lo:400: 00000100:00100000:2.0:1788619800.042326:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.042349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932864 00000100:00100000:2.0:1788619800.042352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932864 00000100:00100000:2.0:1788619800.042378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932736 00000100:00100000:2.0:1788619800.042381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932736 00000100:00100000:2.0:1788619800.042393:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788619800.042399:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676932864:12345-0@lo:400: 00000100:00100000:2.0:1788619800.042427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676932864:12345-0@lo:400: Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.042433:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788619800.042445:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788619800.042450:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676932736:12345-0@lo:400: 00000100:00100000:2.0:1788619800.042478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676932736:12345-0@lo:400: Request processed in 28us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.042483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788619800.042516:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94ff800 x1875503676932736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619800.042529:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676932736:0@lo:400: 00010000:00080000:2.0:1788619800.042554:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fea00 x1875503676932992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619800.042575:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676932992:0@lo:400: 00010000:00080000:2.0:1788619800.042588:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fc700 x1875503676932864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619800.042595:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676932864:0@lo:400: 00000100:00100000:1.0:1788619800.045148:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503676932608:0@lo:38: 00000100:00100000:1.0:1788619800.045214:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619800.045274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676932608 00000100:00100000:1.0:1788619800.045282:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676932608 00000100:00100000:1.0:1788619800.045320:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619800.045328:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875503676932608:12345-0@lo:38: 00010000:00080000:1.0:1788619800.045355:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1788619800.045392:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb0e330328bbdfda 00000004:00100000:1.0:1788619800.045424:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788619800.045466:0:5841:0:(import.c:65:import_set_state_nolock()) ffff933284ea9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788619800.045522:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875503676932608:12345-0@lo:38: Request processed in 193us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619800.045529:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788619800.045551:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788619800.045711:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788619800.045895:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fed80 x1875503676932608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788619810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619800.045906:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788619800.045913:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788619800.045920:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788619800.045925:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788619800.045927:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788619800.045933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503676932608:0@lo:38: 00000040:00080000:1.0:1788619800.047876:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788619800.049712:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788619800.049747:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788619800.049768:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619800.049798:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788619800.049870:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788619800.049872:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788619800.049874:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788619800.049875:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788619800.049877:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788619800.049878:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788619800.049880:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788619800.049881:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788619800.049882:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788619800.049884:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788619800.049885:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788619800.049889:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788619800.049892:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788619800.049893:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788619800.049894:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788619800.049896:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788619800.049897:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788619800.049898:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788619800.049899:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788619800.049900:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788619800.049901:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788619800.049902:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788619800.049903:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788619800.049928:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788619800.049944:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676933120:0@lo:253: 00000100:00100000:0.0:1788619800.050010:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619800.050043:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e61000 going to sleep for 11 seconds 00000100:00100000:1.0:1788619800.051384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933120 00000100:00100000:1.0:1788619800.051396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933120 00000100:00100000:1.0:1788619800.051464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788619800.051473:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7628:x1875503676933120:12345-0@lo:253: 20000000:01000000:1.0:1788619800.051504:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788619800.051518:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788619800.055903:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875503676933248:0@lo:901: 00000100:00100000:3.0:1788619800.055978:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619800.056008:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.056082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933248 00000100:00100000:0.0:1788619800.056089:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933248 00000100:00100000:0.0:1788619800.056145:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788619800.056153:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875503676933248:12345-0@lo:901: 00000100:00080000:2.0:1788619800.056671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619800.057711:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875503676933248:12345-0@lo:901: Request processed in 1554us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619800.057723:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788619800.058077:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715c380 x1875503676933248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788619816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619800.058091:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875503676933248:0@lo:901: 20000000:01000000:0.0:1788619800.095327:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788619800.095348:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788619800.095512:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788619800.095517:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788619800.095542:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.095649:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.095675:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.095734:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.095879:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 14 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619800.095894:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676933376:0@lo:104: 00000100:00100000:2.0:1788619800.095991:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.096090:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf412000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619800.096221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933376 00000100:00100000:0.0:1788619800.096228:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933376 00000100:00100000:0.0:1788619800.096274:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788619800.096283:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676933376:12345-0@lo:104: 00010000:00010000:0.0:1788619800.096305:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619800.096350:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788619800.096356:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:5856:x1875503676933376:12345-0@lo:104: Request processed in 75us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619800.096362:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788619800.098850:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875503676933376:0@lo:104: 00010000:00010000:2.0:1788619800.098878:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.098899:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619800.098905:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.098913:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebc00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788619800.098917:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.098927:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788619800.098934:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619800.098939:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788619800.098978:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.098984:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619800.099001:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.099008:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbdf63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.099023:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619800.099038:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619800.099040:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619800.099055:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676933504:0@lo:103: 00000100:00100000:2.0:1788619800.099117:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619800.101922:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933504 00000100:00100000:2.0:1788619800.101938:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933504 00010000:00010000:2.0:1788619800.101976:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 15 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619800.102012:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788619800.102021:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387306050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+15:3311:x1875503676933504:12345-0@lo:103: 00010000:00010000:2.0:1788619800.102035:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619800.102040:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 15 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102052:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 15 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102069:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030e00/0xbb0e330328bbdf6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf63 expref: 15 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102085:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102094:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788619800.102109:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006592692s 00010000:00010000:2.0:1788619800.102114:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102140:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102147:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102154:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102161:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eba00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619800.102165:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102174:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102190:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102202:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619800.102269:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387306050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+14:3311:x1875503676933504:12345-0@lo:103: Request processed in 249us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.102276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788619800.102352:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102361:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619800.102368:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbdfe1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619800.102416:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676933504:0@lo:103: 00000100:00100000:2.0:1788619800.103231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:7628:x1875503676933120:12345-0@lo:253: Request processed in 51756us (53218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619800.103241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788619800.103410:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42040134-1c22-4778-8507-c9e1e3983208:7628:1875503676933120:0@lo:253: 10000000:01000000:1.0:1788619800.103422:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788619800.103425:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788619800.103427:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788619800.103428:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788619800.103429:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788619800.103430:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788619800.103431:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788619800.103432:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788619800.103434:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788619800.103435:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788619800.103436:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788619800.103438:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788619800.103463:0:7628:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788619800.109687:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619800.110036:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788619800.110226:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788619800.110383:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788619800.116084:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788619800.116347:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788619800.118033:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788619800.341279:0:7628:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788619800.341304:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788619800.341338:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788619800.341402:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788619800.341416:0:7628:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788619800.341505:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788619801.031044:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619802.061545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619802.824429:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619802.824451:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676933632:0@lo:13: 00000100:00100000:3.0:1788619802.824519:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619802.824581:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933632 00000100:00100000:3.0:1788619802.824594:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933632 00000100:00100000:3.0:1788619802.824650:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788619802.824658:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676933632:12345-0@lo:13: 00002000:00000024:3.0:1788619802.824689:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619802.824733:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676933632:12345-0@lo:13: Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619802.824740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788619802.824759:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788619802.824802:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715f800 x1875503676933632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619802.824818:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676933632:0@lo:13: 00010000:00010000:2.0:1788619803.083581:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619804.105766:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619805.129078:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619805.385333:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676933760:0@lo:400: 00000100:00100000:3.0:1788619805.385385:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676934016:0@lo:400: 00000100:00100000:2.0:1788619805.385407:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619805.385416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619805.385456:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676934272:0@lo:400: 00000100:00100000:3.0:1788619805.387025:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619805.387038:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676934144:0@lo:400: 00000100:00100000:3.0:1788619805.387083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619805.387384:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933760 00000100:00100000:3.0:1788619805.387392:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933760 00000100:00100000:3.0:1788619805.387436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788619805.387445:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:3309:x1875503676933760:12345-0@lo:400: 00000100:00100000:3.0:1788619805.387524:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:3309:x1875503676933760:12345-0@lo:400: Request processed in 80us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619805.387532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788619805.387596:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676933888:0@lo:400: 00000100:00100000:3.0:1788619805.387622:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619805.389182:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619805.389249:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676933760:0@lo:400: 00000100:00100000:2.0:1788619805.389300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934016 00000100:00100000:2.0:1788619805.389306:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934016 00000100:00100000:2.0:1788619805.389346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676933888 00000100:00100000:2.0:1788619805.389349:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676933888 00000100:00100000:2.0:1788619805.389362:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934272 00000100:00100000:2.0:1788619805.389364:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934272 00000100:00100000:2.0:1788619805.389393:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788619805.389401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676934016:12345-0@lo:400: 00000100:00100000:2.0:1788619805.389454:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676934016:12345-0@lo:400: Request processed in 54us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619805.389473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788619805.389490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788619805.389496:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676933888:12345-0@lo:400: 00000100:00100000:2.0:1788619805.389538:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676933888:12345-0@lo:400: Request processed in 42us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619805.389543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788619805.389569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788619805.389575:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676934272:12345-0@lo:400: 00000100:00080000:3.0:1788619805.389636:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619805.389830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676934272:12345-0@lo:400: Request processed in 255us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619805.389896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788619805.389931:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fca80 x1875503676933888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619805.389944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676933888:0@lo:400: 00010000:00080000:2.0:1788619805.390055:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94ff800 x1875503676934016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619805.390066:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676934016:0@lo:400: 00010000:00080000:2.0:1788619805.390097:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fc380 x1875503676934272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619805.390106:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676934272:0@lo:400: 00000100:00100000:1.0:1788619805.390502:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934144 00000100:00100000:1.0:1788619805.390509:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934144 00000100:00100000:1.0:1788619805.392682:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788619805.392696:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676934144:12345-0@lo:400: 00000100:00100000:1.0:1788619805.392808:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676934144:12345-0@lo:400: Request processed in 116us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619805.392815:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788619805.394322:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fe300 x1875503676934144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619805.394338:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676934144:0@lo:400: 00000100:00080000:2.0:1788619805.395573:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788619806.153735:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788619806.849979:0:7988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788619806.918896:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788619806.918904:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333bbf76000 from 30 10000000:01000000:2.0:1788619806.918909:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788619806.918961:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.918973:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.918983:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619806.919004:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934400:0@lo:101: 00000100:00100000:2.0:1788619806.919065:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.919117:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc3903c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619806.919297:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934400 00000100:00100000:1.0:1788619806.919305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934400 00000100:00100000:1.0:1788619806.919424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788619806.919434:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676934400:12345-0@lo:101: 00010000:00010000:1.0:1788619806.919447:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619806.919462:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdfe8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.919484:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.919495:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.919503:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf600, rc 0) 00000100:00100000:1.0:1788619806.919541:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676934400:12345-0@lo:101: Request processed in 109us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619806.919548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788619806.919647:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934400:0@lo:101: 00010000:00010000:2.0:1788619806.919661:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.919671:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619806.919718:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934528:0@lo:501: 00000100:00100000:2.0:1788619806.919742:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.919758:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc3903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619806.919793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934528 00000100:00100000:2.0:1788619806.919797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934528 00000100:00100000:2.0:1788619806.920903:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788619806.920919:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676934528:12345-0@lo:501: 00000100:00100000:2.0:1788619806.921614:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676934528:12345-0@lo:501: Request processed in 699us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619806.921624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788619806.921726:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934528:0@lo:501: 00000100:00100000:3.0:1788619806.921798:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934656:0@lo:503: 00000100:00100000:3.0:1788619806.921981:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.922013:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90540 going to sleep for 11 seconds 00000100:00100000:2.0:1788619806.924101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934656 00000100:00100000:2.0:1788619806.924112:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934656 00000100:00100000:2.0:1788619806.924166:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788619806.924176:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676934656:12345-0@lo:503: 00000100:00100000:2.0:1788619806.924790:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676934656:12345-0@lo:503: Request processed in 595us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619806.924799:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788619806.924921:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676934656:0@lo:503: 00000100:00100000:2.0:1788619806.925156:0:7992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7992:1875503676934784:0@lo:502: 00000100:00100000:2.0:1788619806.925201:0:7992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.925227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934784 00000100:00100000:2.0:1788619806.925232:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934784 00000100:00100000:2.0:1788619806.925274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788619806.925281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:7992:x1875503676934784:12345-0@lo:502: 00000100:00100000:2.0:1788619806.926019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:7992:x1875503676934784:12345-0@lo:502: Request processed in 736us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619806.926030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788619806.926087:0:7992:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619806.926104:0:7992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7992:1875503676934784:0@lo:502: 00000100:00100000:2.0:1788619806.926156:0:7992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7992:1875503676934912:0@lo:502: 00000100:00100000:2.0:1788619806.926193:0:7992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.927009:0:7992:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.928234:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676934912 00000100:00100000:0.0:1788619806.928244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676934912 00000100:00100000:0.0:1788619806.928307:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788619806.928318:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7992:x1875503676934912:12345-0@lo:502: 00000100:00100000:0.0:1788619806.932603:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:7992:x1875503676934912:12345-0@lo:502: Request processed in 4279us (6400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.932616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788619806.932701:0:7992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7992:1875503676934912:0@lo:502: 00000040:00080000:2.0:1788619806.932754:0:7992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788619806.933009:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788619806.933026:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788619806.933037:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.933047:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619806.933055:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788619806.933058:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788619806.933060:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788619806.933090:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.933098:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.933106:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.933124:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935040:0@lo:101: 00000100:00100000:3.0:1788619806.933173:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.933207:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619806.933259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935040 00000100:00100000:2.0:1788619806.933265:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935040 00000100:00100000:2.0:1788619806.934434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788619806.934449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676935040:12345-0@lo:101: 00010000:00010000:2.0:1788619806.934465:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619806.934482:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbdff6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.934508:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.934520:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619806.934528:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebc00, rc 0) 00000100:00100000:2.0:1788619806.934597:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676935040:12345-0@lo:101: Request processed in 153us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619806.934604:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788619806.934633:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935040:0@lo:101: 00010000:00010000:0.0:1788619806.934649:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.934669:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619806.934729:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935168:0@lo:501: 00000100:00100000:0.0:1788619806.934830:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.934857:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387281180 going to sleep for 11 seconds 00000100:00100000:3.0:1788619806.935012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935168 00000100:00100000:3.0:1788619806.935018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935168 00000100:00100000:3.0:1788619806.935062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788619806.935069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676935168:12345-0@lo:501: 00000100:00100000:3.0:1788619806.935377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676935168:12345-0@lo:501: Request processed in 307us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619806.935385:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788619806.943959:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935168:0@lo:501: 00000100:00100000:0.0:1788619806.944020:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935296:0@lo:503: 00000100:00100000:0.0:1788619806.944095:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.944145:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387281180 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.944166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935296 00000100:00100000:0.0:1788619806.944171:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935296 00000100:00100000:0.0:1788619806.944222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788619806.944230:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676935296:12345-0@lo:503: 00000100:00100000:0.0:1788619806.944500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676935296:12345-0@lo:503: Request processed in 269us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.944508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788619806.944565:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935296:0@lo:503: 00000100:00100000:2.0:1788619806.951036:0:7994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7994:1875503676935424:0@lo:502: 00000100:00100000:2.0:1788619806.951114:0:7994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.951161:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935424 00000100:00100000:2.0:1788619806.951167:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935424 00000100:00100000:2.0:1788619806.951207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788619806.951215:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:7994:x1875503676935424:12345-0@lo:502: 00000100:00100000:2.0:1788619806.951455:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:7994:x1875503676935424:12345-0@lo:502: Request processed in 240us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.955960:0:7994:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.956004:0:7994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7994:1875503676935424:0@lo:502: 00000020:01000000:0.0:1788619806.956045:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788619806.956055:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619806.956057:0:7994:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788619806.956061:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788619806.956063:0:7994:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788619806.956102:0:7994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7994:1875503676935552:0@lo:502: 00000100:00100000:0.0:1788619806.956173:0:7994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.956208:0:7994:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390326480 going to sleep for 11 seconds 00000100:00100000:1.0:1788619806.956259:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935552 00000100:00100000:1.0:1788619806.956273:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935552 00000100:00100000:1.0:1788619806.956327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788619806.956336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:7994:x1875503676935552:12345-0@lo:502: 00000100:00100000:1.0:1788619806.956562:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:7994:x1875503676935552:12345-0@lo:502: Request processed in 227us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619806.956570:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788619806.956657:0:7994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7994:1875503676935552:0@lo:502: 00000020:01000000:0.0:1788619806.956678:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788619806.956682:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619806.956684:0:7994:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788619806.956687:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788619806.956909:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788619806.956937:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788619806.956946:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.956956:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619806.956966:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788619806.956969:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93338a7b5000 from 30 10000000:01000000:1.0:1788619806.956971:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788619806.957043:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.957051:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619806.957060:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619806.957074:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935680:0@lo:101: 00000100:00100000:1.0:1788619806.957105:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619806.957134:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.957146:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935680 00000100:00100000:0.0:1788619806.957150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935680 00000100:00100000:0.0:1788619806.957219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788619806.957229:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676935680:12345-0@lo:101: 00010000:00010000:0.0:1788619806.957238:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619806.957260:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe004 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.957279:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.957289:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.957297:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031800, rc 0) 00000100:00100000:0.0:1788619806.957337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676935680:12345-0@lo:101: Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.957343:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788619806.959033:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935680:0@lo:101: 00010000:00010000:3.0:1788619806.959055:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.959068:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.959205:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935808:0@lo:501: 00000100:00100000:3.0:1788619806.959269:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619806.959369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788619806.962687:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619806.964293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935808 00000100:00100000:2.0:1788619806.964305:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935808 00000100:00100000:2.0:1788619806.964347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788619806.964356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676935808:12345-0@lo:501: 00000100:00100000:2.0:1788619806.964673:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676935808:12345-0@lo:501: Request processed in 317us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619806.964680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788619806.966525:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935808:0@lo:501: 00000100:00100000:3.0:1788619806.966578:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935936:0@lo:503: 00000100:00100000:3.0:1788619806.966639:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.966672:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.966965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676935936 00000100:00100000:0.0:1788619806.966972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676935936 00000100:00100000:0.0:1788619806.967026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788619806.967042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676935936:12345-0@lo:503: 00000100:00100000:0.0:1788619806.967221:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676935936:12345-0@lo:503: Request processed in 180us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.967228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788619806.967634:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676935936:0@lo:503: 00000100:00100000:0.0:1788619806.969094:0:7996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7996:1875503676936064:0@lo:502: 00000100:00100000:0.0:1788619806.969161:0:7996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.969203:0:7996:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:1.0:1788619806.969260:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936064 00000100:00100000:1.0:1788619806.969271:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936064 00000100:00100000:1.0:1788619806.969325:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788619806.969333:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:7996:x1875503676936064:12345-0@lo:502: 00000100:00100000:1.0:1788619806.969544:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:7996:x1875503676936064:12345-0@lo:502: Request processed in 210us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619806.969551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788619806.969689:0:7996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7996:1875503676936064:0@lo:502: 00000100:00100000:0.0:1788619806.969733:0:7996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7996:1875503676936192:0@lo:502: 00000100:00100000:0.0:1788619806.970001:0:7996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.970023:0:7996:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:1.0:1788619806.970062:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936192 00000100:00100000:1.0:1788619806.970068:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936192 00000100:00100000:1.0:1788619806.970099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788619806.970107:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:7996:x1875503676936192:12345-0@lo:502: 00000100:00100000:1.0:1788619806.970266:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:7996:x1875503676936192:12345-0@lo:502: Request processed in 160us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619806.970273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788619806.970428:0:7996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7996:1875503676936192:0@lo:502: 00000040:00080000:2.0:1788619806.970450:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788619806.970951:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788619806.970970:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788619806.970986:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.970996:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619806.971005:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788619806.971008:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93338a7b5000 from 5 10000000:01000000:3.0:1788619806.971010:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788619806.971038:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.971046:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.971056:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.971071:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936320:0@lo:101: 00000100:00100000:3.0:1788619806.971106:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619806.971159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936320 00000100:00100000:0.0:1788619806.971164:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936320 00000100:00100000:0.0:1788619806.971201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788619806.971208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676936320:12345-0@lo:101: 00010000:00010000:0.0:1788619806.971218:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619806.971231:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031a00/0xbb0e330328bbe019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe012 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.971262:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031a00/0xbb0e330328bbe019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe012 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.971273:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031a00/0xbb0e330328bbe019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe012 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.971281:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031a00, rc 0) 00000100:00100000:0.0:1788619806.975016:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676936320:12345-0@lo:101: Request processed in 3534us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.975043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788619806.979312:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619806.979349:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936320:0@lo:101: 00010000:00010000:3.0:1788619806.979437:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.979450:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.979511:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936448:0@lo:256: 00000100:00100000:3.0:1788619806.979579:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.979607:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.979806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936448 00000100:00100000:0.0:1788619806.979930:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936448 00000100:00100000:0.0:1788619806.979988:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788619806.979997:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676936448:12345-0@lo:256: 20000000:01000000:0.0:1788619806.980016:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788619806.980032:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788619806.980035:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788619806.980147:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676936448:12345-0@lo:256: Request processed in 150us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.980155:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788619806.980185:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936448:0@lo:256: 10000000:01000000:3.0:1788619806.980241:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788619806.980262:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.980272:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619806.980282:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788619806.980284:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788619806.980286:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788619806.980310:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.980317:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.980326:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.980340:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936576:0@lo:101: 00000100:00100000:3.0:1788619806.980378:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.980399:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.980462:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936576 00000100:00100000:0.0:1788619806.980467:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936576 00000100:00100000:0.0:1788619806.980497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788619806.980503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676936576:12345-0@lo:101: 00010000:00010000:0.0:1788619806.980511:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619806.980524:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe020 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.980543:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.980553:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619806.980562:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030000, rc 0) 00000100:00100000:0.0:1788619806.980598:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676936576:12345-0@lo:101: Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.980614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788619806.980628:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936576:0@lo:101: 00010000:00010000:3.0:1788619806.980641:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619806.980659:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619806.980706:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936704:0@lo:501: 00000100:00100000:3.0:1788619806.980731:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.980832:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.982514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936704 00000100:00100000:0.0:1788619806.982527:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936704 00000100:00100000:0.0:1788619806.982585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788619806.982595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676936704:12345-0@lo:501: 00000100:00100000:0.0:1788619806.983416:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676936704:12345-0@lo:501: Request processed in 818us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.983426:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788619806.983562:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936704:0@lo:501: 00000100:00100000:3.0:1788619806.983610:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936832:0@lo:503: 00000100:00100000:3.0:1788619806.983658:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.983685:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.984935:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936832 00000100:00100000:0.0:1788619806.984946:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936832 00000100:00100000:0.0:1788619806.985001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788619806.985010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676936832:12345-0@lo:503: 00000100:00100000:0.0:1788619806.985315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676936832:12345-0@lo:503: Request processed in 305us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.985322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788619806.986689:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676936832:0@lo:503: 00000100:00100000:3.0:1788619806.988407:0:7998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7998:1875503676936960:0@lo:502: 00000100:00100000:3.0:1788619806.988482:0:7998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619806.988535:0:7998:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619806.988905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676936960 00000100:00100000:0.0:1788619806.988912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676936960 00000100:00100000:0.0:1788619806.988959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788619806.988967:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:7998:x1875503676936960:12345-0@lo:502: 00000100:00100000:0.0:1788619806.990461:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:7998:x1875503676936960:12345-0@lo:502: Request processed in 1489us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619806.990471:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788619806.991968:0:7998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7998:1875503676936960:0@lo:502: 00000020:01000000:3.0:1788619806.992010:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788619806.992018:0:7998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788619806.992026:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619806.992028:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788619806.992034:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788619806.992038:0:7998:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788619806.992062:0:7998:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788619806.992064:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788619806.992077:0:7998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9333bd344d40) 00000020:00000080:3.0:1788619806.992095:0:7998:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788619806.992099:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788619806.992187:0:7998:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788619806.992196:0:7998:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788619806.992202:0:7998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbe035 00010000:00080000:3.0:1788619806.992229:0:7998:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333a53c4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788619806.992437:0:7998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788619806.992749:0:7998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788619806.992763:0:7998:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788619806.995460:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619806.995688:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788619806.995737:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788619806.996113:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788619806.998389:0:8000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619806.998397:0:8000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788619806.999638:0:7998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788619806.999725:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788619806.999768:0:7998:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788619807.000381:0:7998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbe03c 00000100:00080000:0.0:1788619807.000394:0:7998:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788619807.000409:0:7998:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9333a53c4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788619807.000444:0:7998:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333909db100 x1875503676937088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788619807.000475:0:7998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788619807.000544:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788619807.000551:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619807.000553:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788619807.000556:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788619807.000559:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619807.000561:0:7998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788619807.000563:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788619807.000565:0:7998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788619807.000593:0:7998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7998:1875503676937216:0@lo:502: 00000100:00100000:3.0:1788619807.000679:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676937344:0@lo:400: 00000100:00100000:2.0:1788619807.001443:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676937088:0@lo:8: 00000100:00100000:3.0:1788619807.003140:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.003190:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788619807.003199:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676937728:0@lo:400: 00000100:00100000:3.0:1788619807.003227:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.003277:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676937472:0@lo:400: 00000100:00100000:3.0:1788619807.003314:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.003336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619807.003342:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676937600:0@lo:400: 00000100:00100000:3.0:1788619807.003366:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.003413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937344 00000100:00100000:3.0:1788619807.003421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937344 00000100:00100000:3.0:1788619807.003458:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937728 00000100:00100000:3.0:1788619807.003461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937728 00000100:00100000:3.0:1788619807.003483:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937472 00000100:00100000:3.0:1788619807.003486:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937472 00000100:00100000:3.0:1788619807.003505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788619807.004302:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676937344:12345-0@lo:400: 00000100:00100000:3.0:1788619807.004367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676937344:12345-0@lo:400: Request processed in 856us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.004379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788619807.004401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788619807.004407:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676937728:12345-0@lo:400: 00000100:00100000:3.0:1788619807.004435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676937728:12345-0@lo:400: Request processed in 28us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.004439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788619807.004450:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788619807.004455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676937472:12345-0@lo:400: 00000100:00100000:3.0:1788619807.004484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676937472:12345-0@lo:400: Request processed in 29us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.004489:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788619807.005072:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937600 00000100:00100000:3.0:1788619807.005080:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937600 00000100:00100000:3.0:1788619807.005119:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788619807.005127:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676937600:12345-0@lo:400: 00000100:00100000:3.0:1788619807.005165:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676937600:12345-0@lo:400: Request processed in 40us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.005172:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788619807.005188:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788619807.005192:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788619807.005225:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715df80 x1875503676937600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.005239:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676937600:0@lo:400: 00010000:00080000:3.0:1788619807.005266:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715ce00 x1875503676937472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.005289:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676937472:0@lo:400: 00010000:00080000:3.0:1788619807.005329:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715d180 x1875503676937728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.005338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676937728:0@lo:400: 00010000:00080000:3.0:1788619807.005348:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715dc00 x1875503676937344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.005355:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676937344:0@lo:400: 00000100:00100000:0.0:1788619807.007101:0:7998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.007235:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937216 00000100:00100000:3.0:1788619807.007245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937216 00000100:00100000:3.0:1788619807.007300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788619807.007308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:7998:x1875503676937216:12345-0@lo:502: 00000100:00100000:2.0:1788619807.007619:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619807.007685:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937088 00000100:00100000:2.0:1788619807.007689:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937088 00000100:00100000:2.0:1788619807.007709:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788619807.007714:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503676937088:12345-0@lo:8: 00010000:00080000:2.0:1788619807.007735:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1788619807.007762:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbe043 00002000:00100000:2.0:1788619807.007901:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9332849a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788619807.007906:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788619807.007910:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788619807.008083:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788619807.008258:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788619807.008285:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9332849a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619807.008336:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503676937088:12345-0@lo:8: Request processed in 621us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619807.008343:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788619807.008414:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333909db100 x1875503676937088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788619817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619807.008424:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788619807.008432:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788619807.008440:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788619807.008445:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788619807.008447:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788619807.008461:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788619807.008466:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503676937088:0@lo:8: 00000004:00080000:2.0:1788619807.008491:0:8000:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788619807.009076:0:8000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209977303212ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788619807.009195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:7998:x1875503676937216:12345-0@lo:502: Request processed in 1886us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.009204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788619807.015282:0:7998:0:(client.c:2716:ptlrpc_set_wait()) set ffff933396037b40 going to sleep for 10 seconds 00000100:00100000:0.0:1788619807.015326:0:7998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:7998:1875503676937216:0@lo:502: 00000020:01000000:0.0:1788619807.015368:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788619807.015378:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619807.015380:0:7998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788619807.015384:0:7998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788619807.015472:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788619807.015489:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788619807.015499:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.015522:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619807.015533:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788619807.015543:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9333871319c0 from 1 10000000:01000000:0.0:1788619807.015546:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788619807.015579:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.015587:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.015598:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619807.015615:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676937856:0@lo:101: 00000100:00100000:0.0:1788619807.015815:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619807.015906:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933396037b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788619807.016091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937856 00000100:00100000:0.0:1788619807.016099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937856 00000100:00100000:0.0:1788619807.016154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788619807.016163:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676937856:12345-0@lo:101: 00010000:00010000:0.0:1788619807.016176:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619807.016188:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe04a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.016211:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.016223:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.016232:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031400, rc 0) 00000100:00100000:0.0:1788619807.016280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676937856:12345-0@lo:101: Request processed in 117us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619807.016292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788619807.016333:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676937856:0@lo:101: 00010000:00010000:0.0:1788619807.016347:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.016356:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619807.016401:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676937984:0@lo:501: 00000100:00100000:0.0:1788619807.016426:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619807.016440:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933396037b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788619807.016452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676937984 00000100:00100000:0.0:1788619807.016456:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676937984 00000100:00100000:0.0:1788619807.016476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788619807.016482:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676937984:12345-0@lo:501: 00000100:00100000:0.0:1788619807.018085:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676937984:12345-0@lo:501: Request processed in 1594us (1650us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788619807.018098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788619807.018158:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676937984:0@lo:501: 10000000:01000000:0.0:1788619807.018192:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788619807.018200:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619807.018211:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788619807.066311:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788619807.110906:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676938112:0@lo:13: 00000100:00100000:3.0:1788619807.110982:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788619807.111077:0:8001:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788619807.111100:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938240:0@lo:7: 00000100:00100000:2.0:1788619807.111128:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619807.111149:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788619807.114542:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938112 00000100:00100000:3.0:1788619807.114556:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938112 00000100:00100000:3.0:1788619807.114614:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788619807.114625:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676938112:12345-0@lo:13: 00002000:00000024:3.0:1788619807.114663:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788619807.114740:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676938112:12345-0@lo:13: Request processed in 117us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.114747:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788619807.118052:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788619807.118075:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938240 00000100:00100000:2.0:1788619807.118084:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938240 00000100:00100000:2.0:1788619807.118133:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788619807.118142:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8001:x1875503676938240:12345-0@lo:7: 00010000:00080000:1.0:1788619807.139111:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fc700 x1875503676938112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619807.139153:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676938112:0@lo:13: 00002000:00080000:2.0:1788619807.151891:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788619807.151902:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788619807.151995:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8001:x1875503676938240:12345-0@lo:7: Request processed in 33850us (40861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619807.152006:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788619807.158705:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fd180 x1875503676938240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788619823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619807.158743:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938240:0@lo:7: 00000004:00080000:2.0:1788619807.158764:0:8001:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788619807.158828:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938368:0@lo:5: 00000100:00100000:2.0:1788619807.158919:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619807.158964:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788619807.162884:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938368 00000100:00100000:3.0:1788619807.162898:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938368 00000100:00100000:3.0:1788619807.162952:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788619807.162970:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8001:x1875503676938368:12345-0@lo:5: 00002000:00080000:3.0:1788619807.163005:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788619807.163008:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788619807.166281:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8001:x1875503676938368:12345-0@lo:5: Request processed in 3313us (7354us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788619807.166296:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788619807.171369:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fd180 x1875503676938368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619807.171388:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938368:0@lo:5: 00000004:00080000:2.0:1788619807.171401:0:8001:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788619807.171436:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938496:0@lo:700: 00000100:00100000:2.0:1788619807.172300:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619807.172344:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788619807.172573:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938496 00000100:00100000:3.0:1788619807.172582:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938496 00000100:00100000:3.0:1788619807.172645:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788619807.172653:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8001:x1875503676938496:12345-0@lo:700: 00000100:00100000:3.0:1788619807.172694:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1875503676938624:0@lo:700: 00000100:00100000:3.0:1788619807.172728:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.172744:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619807.173078:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938624 00000100:00100000:2.0:1788619807.173083:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938624 00000100:00100000:2.0:1788619807.173112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619807.173119:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1875503676938624:12345-0@lo:700: 00010000:00010000:2.0:1788619807.177111:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1788619807.220846:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788619807.229147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1875503676938624:12345-0@lo:700: Request processed in 56018us (56408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619807.229161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788619807.231161:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4e00 x1875503676938624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788619823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.231177:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1875503676938624:0@lo:700: 40000000:02000000:3.0:1788619807.231191:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788619807.270766:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8001:x1875503676938496:12345-0@lo:700: Request processed in 98105us (98459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.270899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:3.0:1788619807.270935:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788619807.270951:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1788619807.271052:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fd880 x1875503676938496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788619823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.271085:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938496:0@lo:700: 00000004:02000040:3.0:1788619807.293719:0:8001:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788619807.296954:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938752:0@lo:5: 00000100:00100000:3.0:1788619807.297028:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.297079:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938752 00000100:00100000:3.0:1788619807.297086:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938752 00000100:00100000:3.0:1788619807.297139:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788619807.297148:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8001:x1875503676938752:12345-0@lo:5: 00000100:00100000:1.0:1788619807.297885:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31600 going to sleep for 11 seconds 00002000:00080000:2.0:1788619807.302495:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788619807.302514:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:1.0:1788619807.306333:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4e00 x1875503676938752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619807.306349:0:8001:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788619807.306364:0:8001:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9333902c4e00 x1875503676938752/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788619823 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619807.306374:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1875503676938752:0@lo:5: 00000004:00080000:1.0:1788619807.306396:0:8001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788619807.306544:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8001:x1875503676938752:12345-0@lo:5: Request processed in 9396us (9514us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788619807.306555:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788619807.947268:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676938880:0@lo:13: 00000100:00100000:3.0:1788619807.949200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619807.951054:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676938880 00000100:00100000:3.0:1788619807.951066:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676938880 00000100:00100000:3.0:1788619807.951124:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788619807.951136:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676938880:12345-0@lo:13: 00002000:00000024:3.0:1788619807.951175:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619807.951264:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676938880:12345-0@lo:13: Request processed in 130us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619807.951273:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788619807.951320:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503676938880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619807.951340:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676938880:0@lo:13: 00010000:00010000:0.0:1788619808.200104:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619809.222966:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619810.252177:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619811.271231:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788619811.621113:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788619812.039733:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676939008:0@lo:400: 00000100:00100000:2.0:1788619812.039831:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.039875:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503676939520:0@lo:400: 00000100:00100000:2.0:1788619812.039923:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.039949:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788619812.039955:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676939392:0@lo:400: 00000100:00100000:2.0:1788619812.039979:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.040004:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676939136:0@lo:400: 00000100:00100000:2.0:1788619812.040025:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.040039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676939648:0@lo:400: 00000100:00100000:2.0:1788619812.040058:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.040076:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619812.040081:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676939264:0@lo:400: 00000100:00100000:2.0:1788619812.040099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619812.040128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939008 00000100:00100000:2.0:1788619812.040134:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939008 00000100:00100000:2.0:1788619812.040175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788619812.040184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676939008:12345-0@lo:400: 00000100:00100000:2.0:1788619812.040247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676939008:12345-0@lo:400: Request processed in 64us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619812.040254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788619812.040285:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939392 00000100:00100000:2.0:1788619812.040289:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939392 00000100:00100000:2.0:1788619812.040320:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939648 00000100:00100000:2.0:1788619812.040323:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939648 00000100:00100000:2.0:1788619812.040350:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788619812.040357:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676939392:12345-0@lo:400: 00000100:00100000:2.0:1788619812.040389:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676939392:12345-0@lo:400: Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619812.040394:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788619812.040406:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788619812.040412:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676939648:12345-0@lo:400: 00000100:00100000:2.0:1788619812.040440:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676939648:12345-0@lo:400: Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619812.040458:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788619812.040475:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619812.040479:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788619812.040504:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fd880 x1875503676939648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619812.040515:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788619812.040530:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676939648:0@lo:400: 00010000:00080000:2.0:1788619812.040552:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fed80 x1875503676939392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619812.040561:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676939392:0@lo:400: 00000100:00100000:2.0:1788619812.040570:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676939008:0@lo:400: 00000100:00100000:3.0:1788619812.040806:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939520 00000100:00100000:3.0:1788619812.040810:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939520 00000100:00100000:3.0:1788619812.040836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939136 00000100:00100000:3.0:1788619812.040844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939136 00000100:00100000:3.0:1788619812.040857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939264 00000100:00100000:3.0:1788619812.040859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939264 00000100:00100000:3.0:1788619812.040872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788619812.040878:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503676939520:12345-0@lo:400: 00000100:00100000:3.0:1788619812.040919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503676939520:12345-0@lo:400: Request processed in 41us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619812.040925:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788619812.040937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788619812.040942:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676939136:12345-0@lo:400: 00000100:00100000:3.0:1788619812.040970:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676939136:12345-0@lo:400: Request processed in 28us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619812.040975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788619812.040985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788619812.040991:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676939264:12345-0@lo:400: 00000100:00100000:3.0:1788619812.041016:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676939264:12345-0@lo:400: Request processed in 26us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619812.041021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788619812.041152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fe300 x1875503676939264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619812.041162:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676939264:0@lo:400: 00010000:00080000:3.0:1788619812.041173:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fc380 x1875503676939136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619812.041181:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676939136:0@lo:400: 00010000:00080000:3.0:1788619812.041206:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333b94fd180 x1875503676939520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619812.041238:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503676939520:0@lo:400: 00000100:00080000:2.0:1788619812.041535:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788619812.295114:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619812.552347:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619812.552374:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676939776:0@lo:13: 00000100:00100000:1.0:1788619812.552453:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619812.552538:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939776 00000100:00100000:1.0:1788619812.552546:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939776 00000100:00100000:1.0:1788619812.552595:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788619812.552605:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676939776:12345-0@lo:13: 00002000:00000024:1.0:1788619812.552637:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619812.552692:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676939776:12345-0@lo:13: Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619812.552699:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788619812.552815:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd2fce00 x1875503676939776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619812.552834:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676939776:0@lo:13: 00000100:00100000:2.0:1788619813.065760:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788619813.065823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676939904:0@lo:13: 00000100:00100000:2.0:1788619813.065890:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619813.066020:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676939904 00000100:00100000:1.0:1788619813.066029:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676939904 00000100:00100000:1.0:1788619813.066087:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619813.066096:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676939904:12345-0@lo:13: 00002000:00000024:1.0:1788619813.066130:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619813.066188:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676939904:12345-0@lo:13: Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619813.066195:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788619813.066279:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503676939904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619813.066297:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676939904:0@lo:13: 00000100:00100000:2.0:1788619813.149023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.151413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993152 00000100:00100000:0.0:1788619813.151428:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993152 00000100:00100000:0.0:1788619813.151488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:0.0:1788619813.151496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875503656993152:12345-192.168.203.12@tcp:250: 00010000:00080000:0.0:1788619813.151524:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1dd753e7-5c3e-4f40-a5f5-57e3c38c975d@192.168.203.12@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788619813.151550:0:5835:0:(genops.c:1385:class_connect()) connect: client 1dd753e7-5c3e-4f40-a5f5-57e3c38c975d, cookie 0xbb0e330328bbe058 00000100:00080000:0.0:1788619813.151701:0:5835:0:(import.c:65:import_set_state_nolock()) ffff933387163800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788619813.151816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+5:2353:x1875503656993152:12345-192.168.203.12@tcp:250: Request processed in 318us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.151823:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788619813.154831:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619813.155556:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993024 00000100:00100000:2.0:1788619813.155567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993024 00000100:00100000:2.0:1788619813.155628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:2.0:1788619813.155638:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+5:5583:x1875503656993024:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788619813.155654:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619813.155671:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a795 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.155701:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.155712:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.155722:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea200, rc 0) 00000100:00100000:2.0:1788619813.155804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+6:5583:x1875503656993024:12345-192.168.203.12@tcp:101: Request processed in 167us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619813.155811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:1.0:1788619813.158643:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619813.159031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993280 00000100:00100000:2.0:1788619813.159041:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993280 00000100:00100000:2.0:1788619813.159098:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788619813.159109:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+6:5583:x1875503656993280:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788619813.159542:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+6:5583:x1875503656993280:12345-192.168.203.12@tcp:501: Request processed in 432us (905us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788619813.159551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1788619813.170262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.170494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993408 00000100:00100000:0.0:1788619813.170505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993408 00000100:00100000:0.0:1788619813.170562:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1788619813.170573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+6:5583:x1875503656993408:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788619813.170590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619813.170606:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a79c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619813.170634:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619813.170646:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619813.170673:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031c00, rc 0) 00000100:00100000:0.0:1788619813.170731:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+7:5583:x1875503656993408:12345-192.168.203.12@tcp:101: Request processed in 159us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.170739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1788619813.174761:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.174953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993536 00000100:00100000:0.0:1788619813.174964:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993536 00000100:00100000:0.0:1788619813.175028:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1788619813.175038:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+7:5583:x1875503656993536:12345-192.168.203.12@tcp:501: 00000100:00100000:0.0:1788619813.175691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5583:x1875503656993536:12345-192.168.203.12@tcp:501: Request processed in 652us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.175700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:1.0:1788619813.193962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619813.194107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993664 00000100:00100000:2.0:1788619813.194126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993664 00000100:00100000:2.0:1788619813.194235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788619813.194245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5583:x1875503656993664:12345-192.168.203.12@tcp:503: 00000100:00100000:2.0:1788619813.194614:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5583:x1875503656993664:12345-192.168.203.12@tcp:503: Request processed in 370us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619813.194623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1788619813.208607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619813.208995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993792 00000100:00100000:3.0:1788619813.209006:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993792 00000100:00100000:3.0:1788619813.209063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1788619813.209073:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5602:x1875503656993792:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1788619813.209451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5602:x1875503656993792:12345-192.168.203.12@tcp:502: Request processed in 377us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619813.209459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788619813.248380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619813.248517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656993920 00000100:00100000:3.0:1788619813.248529:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656993920 00000100:00100000:3.0:1788619813.248586:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788619813.248594:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5602:x1875503656993920:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1788619813.248897:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5602:x1875503656993920:12345-192.168.203.12@tcp:502: Request processed in 302us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619813.248904:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788619813.259077:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619813.259298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994048 00000100:00100000:2.0:1788619813.259307:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994048 00000100:00100000:2.0:1788619813.259360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1788619813.259370:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5583:x1875503656994048:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788619813.259385:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619813.259403:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6eb800/0xbb0e330328bbe06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a7c6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.259430:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eb800/0xbb0e330328bbe06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7c6 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.259440:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6eb800/0xbb0e330328bbe06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7c6 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619813.259450:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb800, rc 0) 00000100:00100000:2.0:1788619813.259678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5583:x1875503656994048:12345-192.168.203.12@tcp:101: Request processed in 309us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619813.259699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1788619813.265839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.266165:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994176 00000100:00100000:0.0:1788619813.266175:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994176 00000100:00100000:0.0:1788619813.266248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1788619813.266257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5583:x1875503656994176:12345-192.168.203.12@tcp:256: 20000000:01000000:0.0:1788619813.266278:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788619813.266300:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788619813.266304:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788619813.266307:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788619813.266309:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788619813.272908:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5583:x1875503656994176:12345-192.168.203.12@tcp:256: Request processed in 6641us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.272921:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1788619813.279688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619813.279831:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994304 00000100:00100000:3.0:1788619813.279841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994304 00000100:00100000:3.0:1788619813.279970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788619813.279980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5583:x1875503656994304:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1788619813.279997:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619813.280023:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a7cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619813.280053:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619813.280088:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619813.280097:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30a00, rc 0) 00000100:00100000:3.0:1788619813.280153:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5583:x1875503656994304:12345-192.168.203.12@tcp:101: Request processed in 175us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619813.280160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1788619813.283591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.283656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994432 00000100:00100000:0.0:1788619813.283666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994432 00000100:00100000:0.0:1788619813.283727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:0.0:1788619813.283874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5583:x1875503656994432:12345-192.168.203.12@tcp:501: 00000100:00100000:0.0:1788619813.284249:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5583:x1875503656994432:12345-192.168.203.12@tcp:501: Request processed in 378us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.284257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788619813.286639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619813.286851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994560 00000100:00100000:3.0:1788619813.286860:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994560 00000100:00100000:3.0:1788619813.286912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788619813.286921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5583:x1875503656994560:12345-192.168.203.12@tcp:503: 00000100:00100000:3.0:1788619813.287423:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5583:x1875503656994560:12345-192.168.203.12@tcp:503: Request processed in 502us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619813.287432:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788619813.291408:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619813.291688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994688 00000100:00100000:0.0:1788619813.291698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994688 00000100:00100000:0.0:1788619813.291760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1788619813.291792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5608:x1875503656994688:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788619813.292299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5608:x1875503656994688:12345-192.168.203.12@tcp:502: Request processed in 529us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619813.292308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788619813.295246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619813.295333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994816 00000100:00100000:2.0:1788619813.295343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994816 00000100:00100000:2.0:1788619813.295412:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1788619813.295422:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5608:x1875503656994816:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1788619813.296134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5608:x1875503656994816:12345-192.168.203.12@tcp:502: Request processed in 711us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619813.296143:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1788619813.303369:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619813.303884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656994944 00000100:00100000:3.0:1788619813.303895:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656994944 00000100:00100000:3.0:1788619813.303937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788619813.303946:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875503656994944:12345-192.168.203.12@tcp:38: 00010000:00080000:3.0:1788619813.303976:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1788619813.304621:0:5842:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe07b 00000004:00100000:3.0:1788619813.304654:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788619813.304661:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788619813.318921:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788619813.350020:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9333a53c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788619813.350094:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503656994944:12345-192.168.203.12@tcp:38: Request processed in 46146us (46744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619813.350116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00010000:00010000:2.0:1788619814.343068:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619814.372039:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619814.372091:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619814.372438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995072 00000100:00100000:3.0:1788619814.372449:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995072 00000100:00080000:2.0:1788619814.372576:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619814.372679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995200 00000100:00100000:3.0:1788619814.372684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995200 00000100:00100000:1.0:1788619814.376595:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788619814.376621:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:0:x1875503656995072:12345-192.168.203.12@tcp:41: 00000004:00000024:1.0:1788619814.376667:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788619814.377399:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:0:x1875503656995072:12345-192.168.203.12@tcp:41: Request processed in 786us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619814.377408:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788619814.377437:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788619814.377447:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995200:12345-192.168.203.12@tcp:41: 00000004:00000024:1.0:1788619814.377476:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788619814.377509:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995200:12345-192.168.203.12@tcp:41: Request processed in 65us (5418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619814.377516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788619814.383654:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619814.384246:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995328 00000100:00100000:1.0:1788619814.384257:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995328 00000100:00100000:1.0:1788619814.384602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788619814.384614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995328:12345-192.168.203.12@tcp:40: 00000100:00100000:1.0:1788619814.384726:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995328:12345-192.168.203.12@tcp:40: Request processed in 115us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619814.384733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788619814.389822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619814.389875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619814.389965:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995712 00000100:00100000:3.0:1788619814.389975:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995712 00000100:00100000:3.0:1788619814.390031:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788619814.390041:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995712:12345-192.168.203.12@tcp:33: 00000100:00100000:0.0:1788619814.390560:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995456 00000100:00100000:0.0:1788619814.390566:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995456 00000100:00100000:0.0:1788619814.390591:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788619814.390597:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875503656995456:12345-192.168.203.12@tcp:8: 00010000:00080000:0.0:1788619814.390621:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1788619814.390650:0:6691:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe082 00002000:00100000:0.0:1788619814.390661:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11f76a03-c7c3-4513-8603-309aac0577a7/ffff933387166800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788619814.390672:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788619814.391068:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788619814.391100:0:6691:0:(import.c:65:import_set_state_nolock()) ffff933387161800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788619814.391163:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503656995456:12345-192.168.203.12@tcp:8: Request processed in 564us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619814.391171:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788619814.393920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619814.393984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619814.395211:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995584 00000100:00100000:2.0:1788619814.395225:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995584 00000100:00100000:2.0:1788619814.395291:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788619814.395309:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875503656995584:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1788619814.395346:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1788619814.395380:0:6689:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe089 00002000:00100000:2.0:1788619814.395391:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11f76a03-c7c3-4513-8603-309aac0577a7/ffff9332849a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788619814.395416:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788619814.398032:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995840 00000100:00100000:1.0:1788619814.398045:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995840 00000100:00100000:1.0:1788619814.398110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1788619814.398120:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2357:x1875503656995840:12345-192.168.203.12@tcp:400: 00002000:00080000:2.0:1788619814.398454:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788619814.398503:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9332849a6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619814.398598:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503656995584:12345-192.168.203.12@tcp:8: Request processed in 3288us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619814.398624:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788619814.406018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2357:x1875503656995840:12345-192.168.203.12@tcp:400: Request processed in 7886us (12019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619814.406034:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000004:00080000:1.0:1788619814.437834:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 47588us 00000004:00200000:1.0:1788619814.469085:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788619814.469261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:5583:x1875503656995712:12345-192.168.203.12@tcp:33: Request processed in 79215us (79379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619814.469277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788619814.774537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619814.774680:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656995968 00000100:00100000:3.0:1788619814.774690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656995968 00000100:00100000:3.0:1788619814.774756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788619814.774768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:5625:x1875503656995968:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1788619814.774812:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619814.774885:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31000/0xbb0e330328bbe090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.774955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.774969:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.774983:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619814.775016:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788619814.775019:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619814.775036:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.775074:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31000/0xbb0e330328bbe090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7f7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.775093:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7f7 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619814.775101:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619814.775104:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619814.775107:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31c00, rc 0) 00000100:00100000:3.0:1788619814.775168:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:5625:x1875503656995968:12345-192.168.203.12@tcp:101: Request processed in 402us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619814.775176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:2.0:1788619815.366978:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619816.391029:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619817.159064:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676940416:0@lo:400: 00000100:00100000:0.0:1788619817.159157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619817.159234:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676940160:0@lo:400: 00000100:00100000:0.0:1788619817.159234:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788619817.159244:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676940032:0@lo:400: 00000100:00100000:1.0:1788619817.159284:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619817.159288:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619817.159312:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676940544:0@lo:400: 00000100:00100000:1.0:1788619817.159327:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676940672:0@lo:400: 00000100:00100000:0.0:1788619817.159341:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619817.159382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619817.159419:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619817.159425:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676940288:0@lo:400: 00000100:00100000:1.0:1788619817.159446:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619817.159473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940160 00000100:00100000:1.0:1788619817.159480:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940160 00000100:00100000:2.0:1788619817.159491:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940416 00000100:00100000:2.0:1788619817.159497:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940416 00000100:00100000:1.0:1788619817.159517:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940544 00000100:00100000:1.0:1788619817.159521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940544 00000100:00100000:2.0:1788619817.159543:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940672 00000100:00100000:2.0:1788619817.159547:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940672 00000100:00100000:1.0:1788619817.159551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940288 00000100:00100000:1.0:1788619817.159556:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940288 00000100:00100000:2.0:1788619817.159575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788619817.159582:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788619817.159588:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676940416:12345-0@lo:400: 00000100:00100000:1.0:1788619817.159593:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676940160:12345-0@lo:400: 00000100:00100000:2.0:1788619817.159653:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676940416:12345-0@lo:400: Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619817.159660:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676940160:12345-0@lo:400: Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619817.159664:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788619817.159674:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788619817.159694:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788619817.159698:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788619817.159706:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676940672:12345-0@lo:400: 00000100:00100000:1.0:1788619817.159712:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676940544:12345-0@lo:400: 00000100:00100000:2.0:1788619817.159745:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676940672:12345-0@lo:400: Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619817.159752:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788619817.159756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676940544:12345-0@lo:400: Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619817.159765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788619817.159798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940032 00000100:00100000:2.0:1788619817.159804:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940032 00000100:00100000:1.0:1788619817.159819:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619817.159828:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676940288:12345-0@lo:400: 00000100:00100000:2.0:1788619817.159837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788619817.159846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676940032:12345-0@lo:400: 00000100:00100000:1.0:1788619817.159860:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676940288:12345-0@lo:400: Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619817.159866:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788619817.159886:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676940032:12345-0@lo:400: Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619817.159894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788619817.159910:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676940288:0@lo:400: 00000100:00100000:1.0:1788619817.159923:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676940160:0@lo:400: 00000100:00080000:2.0:1788619817.159926:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619817.159932:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788619817.159936:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788619817.159936:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb922300 x1875503676940672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619817.159948:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676940672:0@lo:400: 00000100:00100000:2.0:1788619817.159966:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676940032:0@lo:400: 00000100:00100000:2.0:1788619817.159991:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676940544:0@lo:400: 00010000:00080000:2.0:1788619817.160001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb921180 x1875503676940416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619817.160010:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676940416:0@lo:400: 00000100:00100000:3.0:1788619817.177838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619817.178458:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996096 00000100:00100000:1.0:1788619817.178470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996096 00000100:00100000:1.0:1788619817.178565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788619817.178576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:5677:x1875503656996096:12345-192.168.203.12@tcp:41: 00000004:00000024:1.0:1788619817.178633:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788619817.178695:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:5677:x1875503656996096:12345-192.168.203.12@tcp:41: Request processed in 120us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619817.178703:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:3.0:1788619817.178887:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619817.183052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619817.183208:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996224 00000100:00100000:3.0:1788619817.183217:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996224 00000100:00100000:3.0:1788619817.183294:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788619817.183305:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f76a03-c7c3-4513-8603-309aac0577a7+6:5677:x1875503656996224:12345-192.168.203.12@tcp:13: 00002000:00000024:3.0:1788619817.183354:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619817.183427:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f76a03-c7c3-4513-8603-309aac0577a7+6:5677:x1875503656996224:12345-192.168.203.12@tcp:13: Request processed in 123us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619817.183434:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00080000:2.0:1788619817.183603:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619817.200202:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619817.200293:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996352 00000100:00100000:3.0:1788619817.200304:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996352 00000100:00100000:3.0:1788619817.200389:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788619817.200400:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f76a03-c7c3-4513-8603-309aac0577a7+6:5677:x1875503656996352:12345-192.168.203.12@tcp:13: 00002000:00000024:3.0:1788619817.200448:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619817.200516:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f76a03-c7c3-4513-8603-309aac0577a7+6:5677:x1875503656996352:12345-192.168.203.12@tcp:13: Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619817.200524:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:2.0:1788619817.201231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788619817.414961:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619817.674525:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619817.674549:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676940800:0@lo:13: 00000100:00100000:1.0:1788619817.674614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619817.675794:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940800 00000100:00100000:3.0:1788619817.675805:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940800 00000100:00100000:3.0:1788619817.675855:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788619817.675864:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676940800:12345-0@lo:13: 00002000:00000024:3.0:1788619817.675888:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619817.675953:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676940800:12345-0@lo:13: Request processed in 91us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619817.675960:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788619817.676003:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcc380 x1875503676940800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619817.676021:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676940800:0@lo:13: 00000001:00100000:0.0:1788619817.743171:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000100:00100000:1.0:1788619818.184275:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619818.184316:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676940928:0@lo:13: 00000100:00100000:1.0:1788619818.184421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619818.184610:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676940928 00000100:00100000:3.0:1788619818.184628:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676940928 00000100:00100000:3.0:1788619818.184694:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788619818.184713:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676940928:12345-0@lo:13: 00002000:00000024:3.0:1788619818.184743:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619818.184833:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676940928:12345-0@lo:13: Request processed in 130us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619818.184841:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788619818.185021:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c7480 x1875503676940928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619818.185042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676940928:0@lo:13: 00010000:00010000:3.0:1788619818.443035:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788619818.796098:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000001:00100000:1.0:1788619819.283914:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000100:00100000:0.0:1788619819.422002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619819.422047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619819.422071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619819.422095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619819.422127:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996736 00000100:00100000:0.0:1788619819.422139:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996736 00000100:00100000:0.0:1788619819.422217:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996864 00000100:00100000:0.0:1788619819.422220:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996864 00000100:00100000:0.0:1788619819.422237:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788619819.422250:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656996736:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788619819.422333:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656996736:12345-192.168.203.12@tcp:400: Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619819.422341:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788619819.422360:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788619819.422365:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656996864:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788619819.422396:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656996864:12345-192.168.203.12@tcp:400: Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619819.422402:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788619819.422420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996608 00000100:00100000:0.0:1788619819.422423:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996608 00000100:00100000:0.0:1788619819.422451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788619819.422457:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503656996608:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788619819.422481:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503656996608:12345-192.168.203.12@tcp:400: Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619819.422487:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00080000:0.0:1788619819.422504:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788619819.422509:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619819.422512:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619819.423851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996480 00000100:00100000:2.0:1788619819.423867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996480 00000100:00100000:2.0:1788619819.423948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:2.0:1788619819.423959:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503656996480:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788619819.424046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503656996480:12345-192.168.203.12@tcp:400: Request processed in 89us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619819.424054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00010000:00010000:2.0:1788619819.465455:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619820.032715:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788619820.487254:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619821.511735:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619822.279011:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676941312:0@lo:400: 00000100:00100000:2.0:1788619822.279099:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619822.279224:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676941440:0@lo:400: 00000100:00100000:0.0:1788619822.279259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619822.279313:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788619822.279319:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676941056:0@lo:400: 00000100:00100000:0.0:1788619822.279347:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619822.279368:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676941568:0@lo:400: 00000100:00100000:0.0:1788619822.279388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619822.279424:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941440 00000100:00100000:0.0:1788619822.279431:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941440 00000100:00100000:0.0:1788619822.279487:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788619822.279496:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676941440:12345-0@lo:400: 00000100:00100000:0.0:1788619822.279549:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676941440:12345-0@lo:400: Request processed in 54us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619822.279568:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788619822.279592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941312 00000100:00100000:0.0:1788619822.279596:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941312 00000100:00100000:0.0:1788619822.279620:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941568 00000100:00100000:0.0:1788619822.279623:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941568 00000100:00100000:0.0:1788619822.279637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788619822.279643:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676941312:12345-0@lo:400: 00000100:00100000:0.0:1788619822.279673:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676941312:12345-0@lo:400: Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619822.279679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788619822.279689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788619822.279695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676941568:12345-0@lo:400: 00000100:00100000:0.0:1788619822.279720:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676941568:12345-0@lo:400: Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619822.279726:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788619822.279746:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788619822.279749:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619822.279809:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676941568:0@lo:400: 00010000:00080000:0.0:1788619822.279823:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb923480 x1875503676941440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619822.279831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676941440:0@lo:400: 00000100:00100000:2.0:1788619822.279912:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676941312:0@lo:400: 00000100:00100000:2.0:1788619822.279926:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788619822.279932:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676941184:0@lo:400: 00000100:00100000:2.0:1788619822.279956:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619822.279980:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676941696:0@lo:400: 00000100:00100000:2.0:1788619822.280002:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619822.280042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941184 00000100:00100000:2.0:1788619822.280046:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941184 00000100:00100000:2.0:1788619822.280071:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788619822.280078:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676941184:12345-0@lo:400: 00000100:00100000:2.0:1788619822.280113:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676941184:12345-0@lo:400: Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619822.280119:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788619822.280307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941056 00000100:00100000:2.0:1788619822.280312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941056 00000100:00100000:2.0:1788619822.280382:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788619822.280389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676941056:12345-0@lo:400: 00000100:00100000:2.0:1788619822.280431:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676941056:12345-0@lo:400: Request processed in 42us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619822.280437:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788619822.280491:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676941056:0@lo:400: 00000100:00100000:3.0:1788619822.284973:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941696 00000100:00100000:3.0:1788619822.284989:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941696 00000100:00100000:2.0:1788619822.285124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676941184:0@lo:400: 00000100:00100000:3.0:1788619822.286380:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788619822.286395:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676941696:12345-0@lo:400: 00000100:00100000:3.0:1788619822.286494:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676941696:12345-0@lo:400: Request processed in 104us (6490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619822.286502:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788619822.288231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788619822.288764:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb922300 x1875503676941696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619822.288809:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676941696:0@lo:400: 00010000:00010000:3.0:1788619822.538909:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619822.792032:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788619822.792059:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676941824:0@lo:13: 00000100:00100000:3.0:1788619822.792133:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619822.792216:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941824 00000100:00100000:3.0:1788619822.792223:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941824 00000100:00100000:3.0:1788619822.792279:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788619822.792289:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676941824:12345-0@lo:13: 00002000:00000024:3.0:1788619822.792335:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619822.792390:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676941824:12345-0@lo:13: Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619822.792397:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788619822.792545:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcf480 x1875503676941824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619822.792966:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676941824:0@lo:13: 00000100:00100000:1.0:1788619823.304109:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619823.304152:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676941952:0@lo:13: 00000100:00100000:1.0:1788619823.304253:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619823.304567:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676941952 00000100:00100000:2.0:1788619823.304577:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676941952 00000100:00100000:2.0:1788619823.304637:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788619823.304647:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676941952:12345-0@lo:13: 00002000:00000024:2.0:1788619823.304704:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619823.304799:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676941952:12345-0@lo:13: Request processed in 123us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.304809:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788619823.305095:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c6680 x1875503676941952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619823.305116:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676941952:0@lo:13: 00010000:00010000:2.0:1788619823.564208:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788619823.895092:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaca51970 20000000:00000080:2.0:1788619823.895111:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9333bc040c00 uarg=0000000000000000 20000000:01000000:2.0:1788619823.895161:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788619823.895163:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788619823.895167:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788619823.895171:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788619823.895177:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788619823.895192:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788619823.895195:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788619823.895465:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788619823.895468:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788619823.896170:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788619823.896717:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788619823.896968:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788619823.897012:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788619823.897026:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788619823.897028:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788619823.898037:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788619823.898602:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788619823.898649:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788619823.898696:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788619823.898708:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788619823.898711:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788619823.899529:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788619823.900267:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788619823.900382:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788619823.900418:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788619823.900431:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788619823.900432:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788619823.901165:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788619823.901913:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788619823.901972:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788619823.902005:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1788619823.902019:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788619823.902039:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902069:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902077:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902084:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902091:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902097:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902104:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902110:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902119:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902126:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902202:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902249:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902264:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 9 pid: 5835 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902278:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942080:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619823.902554:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902563:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902572:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942208:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619823.902606:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902615:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 18 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902624:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942336:0@lo:104: 00000100:00100000:2.0:1788619823.902661:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619823.902705:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902713:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 18 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902735:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942464:0@lo:104: 00000100:00100000:2.0:1788619823.902759:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619823.902869:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902877:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 18 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902885:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942592:0@lo:104: 00010000:00010000:2.0:1788619823.902910:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902918:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 18 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902926:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942720:0@lo:104: 00010000:00010000:2.0:1788619823.902949:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902956:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 18 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.902964:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942848:0@lo:104: 00010000:00010000:2.0:1788619823.902985:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.902992:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 18 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.903011:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942976:0@lo:104: 00010000:00010000:2.0:1788619823.903036:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.903044:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 18 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.903051:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676943104:0@lo:104: 00000100:00100000:2.0:1788619823.903066:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619823.906832:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788619823.906877:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619823.906902:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619823.906911:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619823.906920:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619823.906930:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619823.906963:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942336 00000100:00100000:3.0:1788619823.906971:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942336 00000100:00100000:3.0:1788619823.907015:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942464 00000100:00100000:3.0:1788619823.907018:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942464 00000100:00100000:3.0:1788619823.907028:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942592 00000100:00100000:3.0:1788619823.907037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942592 00000100:00100000:3.0:1788619823.907049:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942720 00000100:00100000:3.0:1788619823.907051:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942720 00000100:00100000:3.0:1788619823.907060:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942848 00000100:00100000:3.0:1788619823.907062:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942848 00000100:00100000:3.0:1788619823.907070:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676942976 00000100:00100000:3.0:1788619823.907072:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676942976 00000100:00100000:3.0:1788619823.907082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943104 00000100:00100000:1.0:1788619823.907109:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788619823.907127:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+8:8453:x1875503676942336:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907156:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907236:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619823.907242:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+8:8453:x1875503676942336:12345-0@lo:104: Request processed in 120us (4581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907249:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788619823.907266:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788619823.907272:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+7:8453:x1875503676942464:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907279:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907313:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788619823.907318:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+7:8453:x1875503676942464:12345-0@lo:104: Request processed in 47us (4559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907323:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788619823.907353:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788619823.907358:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+6:8453:x1875503676942592:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907365:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907412:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788619823.907417:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+6:8453:x1875503676942592:12345-0@lo:104: Request processed in 60us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907423:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788619823.907434:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788619823.907460:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:8453:x1875503676942720:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907468:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907501:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788619823.907505:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:8453:x1875503676942720:12345-0@lo:104: Request processed in 48us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907511:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788619823.907524:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788619823.907529:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:8453:x1875503676942848:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907537:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907562:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788619823.907567:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:8453:x1875503676942848:12345-0@lo:104: Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907573:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788619823.907584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788619823.907589:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:8453:x1875503676942976:12345-0@lo:104: 00010000:00010000:1.0:1788619823.907597:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907621:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788619823.907625:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:8453:x1875503676942976:12345-0@lo:104: Request processed in 37us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.907631:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788619823.907646:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788619823.907658:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907665:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380030600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.907669:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907678:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.907685:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.907691:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.907726:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907733:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.907753:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907760:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff933380030600/0xbb0e330328bbe04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907792:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788619823.907796:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907801:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.907804:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907821:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.907828:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.907833:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.907847:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907853:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.907870:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907877:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907888:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788619823.907891:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907897:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.907900:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907907:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.907914:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.907925:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.907939:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907945:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.907950:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907956:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813cf800/0xbb0e330328bbe004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe00b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907965:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788619823.907968:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.907973:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.908091:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908100:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.908106:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.908111:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.908126:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908142:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.908155:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908162:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31400/0xbb0e330328bbdff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdffd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908170:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788619823.908174:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908179:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.908182:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908188:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.908194:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.908198:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.908212:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908217:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.908221:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908227:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ebe00/0xbb0e330328bbdfe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908236:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619823.908244:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908250:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.908253:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908260:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.908267:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.908272:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.908286:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908292:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.908297:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908303:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbdfbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfc5 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.908312:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.908314:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.908315:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.908324:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.908329:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.908335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619823.908357:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943232:0@lo:103: 00000100:00100000:1.0:1788619823.908404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619823.908768:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942336:0@lo:104: 00000100:00100000:0.0:1788619823.908829:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942464:0@lo:104: 00000100:00100000:0.0:1788619823.908838:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942592:0@lo:104: 00000100:00100000:0.0:1788619823.908845:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942720:0@lo:104: 00000100:00100000:0.0:1788619823.908852:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942848:0@lo:104: 00000100:00100000:0.0:1788619823.908859:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942976:0@lo:104: 00000100:00100000:1.0:1788619823.909685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943744:0@lo:103: 00000100:00100000:0.0:1788619823.909724:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676943488:0@lo:103: 00000100:00100000:1.0:1788619823.909737:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619823.909754:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676943360:0@lo:103: 00000100:00100000:0.0:1788619823.909788:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619823.909795:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619823.909801:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943616:0@lo:103: 00000100:00100000:0.0:1788619823.909808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676943872:0@lo:103: 00000100:00100000:1.0:1788619823.909822:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619823.909836:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619823.909849:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943232 00000100:00100000:1.0:1788619823.909855:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943232 00010000:00010000:1.0:1788619823.909885:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 19 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.909906:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943744 00000100:00100000:1.0:1788619823.909909:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943744 00010000:00010000:1.0:1788619823.909921:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 20 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.909931:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943360 00000100:00100000:1.0:1788619823.909933:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943360 00010000:00010000:1.0:1788619823.909942:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 21 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.909951:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943616 00000100:00100000:1.0:1788619823.909953:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943616 00010000:00010000:1.0:1788619823.909962:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 22 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.909971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943872 00000100:00100000:1.0:1788619823.909974:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943872 00000100:00100000:2.0:1788619823.910227:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619823.910421:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943104 00000100:00100000:3.0:1788619823.910469:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788619823.910478:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:8453:x1875503676943104:12345-0@lo:104: 00010000:00010000:3.0:1788619823.910489:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619823.910538:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788619823.910544:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+3:8453:x1875503676943104:12345-0@lo:104: Request processed in 69us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619823.910551:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788619823.910890:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619823.911370:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942080:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619823.911384:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676942208:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619823.911392:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875503676943104:0@lo:104: 00010000:00010000:0.0:1788619823.911435:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911632:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 23 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.911660:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656996992 00000100:00100000:1.0:1788619823.911664:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656996992 00010000:00010000:1.0:1788619823.911672:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 10 pid: 5835 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.911678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997120 00000100:00100000:1.0:1788619823.911679:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997120 00010000:00010000:1.0:1788619823.911687:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 11 pid: 5834 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.911699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788619823.911706:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+23:3312:x1875503676943232:12345-0@lo:103: 00010000:00010000:1.0:1788619823.911719:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619823.911725:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 23 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911735:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 23 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911750:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031400/0xbb0e330328bbe051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe04a expref: 23 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911764:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619823.911829:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+22:3312:x1875503676943232:12345-0@lo:103: Request processed in 123us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.911830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788619823.911835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788619823.911839:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+22:3312:x1875503676943744:12345-0@lo:103: 00010000:00010000:2.0:1788619823.911847:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788619823.911848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788619823.911852:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 21 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619823.911854:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+21:3309:x1875503676943360:12345-0@lo:103: 00010000:00010000:2.0:1788619823.911862:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 21 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911869:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.911871:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cf600/0xbb0e330328bbdfef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdfe8 expref: 21 pid: 5834 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911873:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 21 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.911881:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 20 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912019:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.912047:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+20:3312:x1875503676943744:12345-0@lo:103: Request processed in 209us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.912054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788619823.912076:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788619823.912082:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676943616:12345-0@lo:103: 00010000:00010000:2.0:1788619823.912090:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.912095:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 19 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912102:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 19 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912113:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6ebc00/0xbb0e330328bbdffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdff6 expref: 19 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912122:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.912218:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+18:3312:x1875503676943616:12345-0@lo:103: Request processed in 135us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.912224:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788619823.912237:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788619823.912243:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+17:3309:x1875503676943872:12345-0@lo:103: 00010000:00010000:2.0:1788619823.912251:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.912254:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 17 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912263:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 17 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912272:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031000/0xbb0e330328bbdfc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdfbe expref: 17 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912280:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.912421:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676943872:12345-0@lo:103: Request processed in 178us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.912434:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788619823.912457:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788619823.912464:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2354:x1875503656996992:12345-192.168.203.12@tcp:103: 00010000:00010000:2.0:1788619823.912473:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.912478:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 11 pid: 5835 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912487:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 11 pid: 5835 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912497:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031c00/0xbb0e330328bbe066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a79c expref: 11 pid: 5835 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912505:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.912616:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503656996992:12345-192.168.203.12@tcp:103: Request processed in 151us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.912623:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788619823.912639:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619823.912646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:2355:x1875503656997120:12345-192.168.203.12@tcp:103: 00010000:00010000:2.0:1788619823.912655:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.912659:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912680:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912691:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a795 expref: 9 pid: 5834 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912707:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.912735:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:2355:x1875503656997120:12345-192.168.203.12@tcp:103: Request processed in 90us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.912741:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619823.912802:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619823.912860:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943616:0@lo:103: 00000100:00100000:2.0:1788619823.912870:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943232:0@lo:103: 00000100:00100000:2.0:1788619823.912876:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676943744:0@lo:103: 00000100:00100000:2.0:1788619823.912902:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676943488 00000100:00100000:2.0:1788619823.912906:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676943488 00010000:00010000:2.0:1788619823.912922:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 16 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.912942:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788619823.912948:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387306450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+16:3310:x1875503676943488:12345-0@lo:103: 00010000:00010000:2.0:1788619823.912955:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.912958:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 16 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912967:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 16 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912977:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031800/0xbb0e330328bbe00b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe004 expref: 16 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.912986:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.913020:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387306450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503676943488:12345-0@lo:103: Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.913027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788619823.913052:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676943488:0@lo:103: 00000100:00100000:0.0:1788619823.913249:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676943872:0@lo:103: 00010000:00010000:1.0:1788619823.913612:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030000/0xbb0e330328bbe027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe020 expref: 14 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.913624:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619823.913657:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+13:3309:x1875503676943360:12345-0@lo:103: Request processed in 1803us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619823.913663:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788619823.913993:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676943360:0@lo:103: 00010000:00010000:1.0:1788619823.915767:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619823.916581:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.916593:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eaa00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619823.916597:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.916607:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619823.916614:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619823.916619:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788619823.916716:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.916735:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619823.916795:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.916803:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eaa00/0xbb0e330328bbdf94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf9b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619823.916821:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.916823:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619823.916824:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619823.916893:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676944000:0@lo:103: 00000100:00100000:3.0:1788619823.916958:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619823.918600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944000 00000100:00100000:2.0:1788619823.918613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944000 00010000:00010000:2.0:1788619823.918653:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619823.918706:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788619823.918716:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+13:3310:x1875503676944000:12345-0@lo:103: 00010000:00010000:2.0:1788619823.918731:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619823.918740:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918752:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918768:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031600/0xbb0e330328bbdf9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf94 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918801:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918810:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918826:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918833:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918851:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918858:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918864:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eba00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619823.918868:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.918877:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619823.919428:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619823.919561:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.921170:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.921187:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eba00/0xbb0e330328bbe09e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619823.921204:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619823.921340:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+12:3310:x1875503676944000:12345-0@lo:103: Request processed in 2621us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619823.921349:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788619823.921989:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676944000:0@lo:103: 00000100:00100000:2.0:1788619824.542026:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619824.542068:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619824.542102:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619824.542239:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997376 00000100:00100000:1.0:1788619824.542249:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997376 00000100:00100000:1.0:1788619824.542322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997504 00000100:00100000:1.0:1788619824.542326:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997504 00000100:00100000:1.0:1788619824.542344:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788619824.542353:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503656997376:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788619824.542426:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503656997376:12345-192.168.203.12@tcp:400: Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619824.542433:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788619824.542450:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788619824.542468:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503656997504:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788619824.542491:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503656997504:12345-192.168.203.12@tcp:400: Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619824.542507:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788619824.543066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997248 00000100:00100000:3.0:1788619824.543073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997248 00000100:00100000:3.0:1788619824.543122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788619824.543140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503656997248:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788619824.543180:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503656997248:12345-192.168.203.12@tcp:400: Request processed in 51us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619824.543187:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00080000:2.0:1788619824.543869:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788619824.543875:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619824.543877:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788619824.583376:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619825.607206:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788619825.799029:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788619825.799052:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333861ca800 from 39 10000000:01000000:2.0:1788619825.799057:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788619825.799101:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.799112:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.799134:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619825.799157:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944128:0@lo:101: 00000100:00100000:2.0:1788619825.799226:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.799293:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.799366:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944128 00000100:00100000:0.0:1788619825.799373:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944128 00000100:00100000:0.0:1788619825.799694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788619825.799705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+12:5837:x1875503676944128:12345-0@lo:101: 00010000:00010000:0.0:1788619825.799718:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619825.799730:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380030c00/0xbb0e330328bbe0ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.799763:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380030c00/0xbb0e330328bbe0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0a5 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.799802:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380030c00/0xbb0e330328bbe0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0a5 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.799813:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030c00, rc 0) 00000100:00100000:0.0:1788619825.800060:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944128:12345-0@lo:101: Request processed in 357us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.800066:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788619825.800148:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944128:0@lo:101: 00010000:00010000:2.0:1788619825.800161:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.800169:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619825.800217:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944256:0@lo:501: 00000100:00100000:2.0:1788619825.800241:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.801025:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619825.801114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944256 00000100:00100000:3.0:1788619825.801132:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944256 00000100:00100000:3.0:1788619825.801165:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788619825.801172:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944256:12345-0@lo:501: 00000100:00100000:3.0:1788619825.801473:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944256:12345-0@lo:501: Request processed in 301us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619825.801480:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788619825.802730:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944256:0@lo:501: 00000100:00100000:2.0:1788619825.803283:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944384:0@lo:503: 00000100:00100000:2.0:1788619825.803342:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.803381:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.803512:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944384 00000100:00100000:0.0:1788619825.803519:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944384 00000100:00100000:0.0:1788619825.803558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788619825.803566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944384:12345-0@lo:503: 00000100:00100000:0.0:1788619825.803753:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944384:12345-0@lo:503: Request processed in 180us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.803766:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788619825.804256:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944384:0@lo:503: 00000100:00100000:2.0:1788619825.804710:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8469:1875503676944512:0@lo:502: 00000100:00100000:2.0:1788619825.805358:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.805431:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181480 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.806837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944512 00000100:00100000:1.0:1788619825.806848:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944512 00000100:00100000:1.0:1788619825.806907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788619825.806918:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:8469:x1875503676944512:12345-0@lo:502: 00000100:00100000:1.0:1788619825.807457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:8469:x1875503676944512:12345-0@lo:502: Request processed in 539us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619825.807466:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788619825.807501:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8469:1875503676944512:0@lo:502: 00000100:00100000:2.0:1788619825.807560:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8469:1875503676944640:0@lo:502: 00000100:00100000:2.0:1788619825.807596:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.807629:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181480 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.807730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944640 00000100:00100000:0.0:1788619825.807735:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944640 00000100:00100000:0.0:1788619825.807800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788619825.807807:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:8469:x1875503676944640:12345-0@lo:502: 00000100:00100000:0.0:1788619825.807951:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+13:8469:x1875503676944640:12345-0@lo:502: Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.807960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788619825.808154:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8469:1875503676944640:0@lo:502: 00000040:00080000:2.0:1788619825.808173:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788619825.808462:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788619825.808479:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788619825.808488:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.808499:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619825.808509:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788619825.808511:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788619825.808514:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788619825.808537:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.808545:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.808554:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.808567:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944768:0@lo:101: 00000100:00100000:1.0:1788619825.808597:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.809351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944768 00000100:00100000:2.0:1788619825.809360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944768 00000100:00100000:2.0:1788619825.811022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788619825.811040:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+13:5837:x1875503676944768:12345-0@lo:101: 00010000:00010000:2.0:1788619825.811063:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619825.811081:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.811106:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0b3 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.811124:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0b3 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.811134:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea200, rc 0) 00000100:00100000:2.0:1788619825.811190:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676944768:12345-0@lo:101: Request processed in 159us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.811196:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788619825.811703:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.811730:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944768:0@lo:101: 00010000:00010000:1.0:1788619825.811753:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.811787:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.811851:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944896:0@lo:501: 00000100:00100000:1.0:1788619825.811885:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.811902:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.814040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676944896 00000100:00100000:0.0:1788619825.814162:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676944896 00000100:00100000:0.0:1788619825.814269:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788619825.814284:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676944896:12345-0@lo:501: 00000100:00100000:0.0:1788619825.814576:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676944896:12345-0@lo:501: Request processed in 298us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.814590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788619825.815138:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676944896:0@lo:501: 00000100:00100000:1.0:1788619825.815183:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945024:0@lo:503: 00000100:00100000:1.0:1788619825.815227:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.816129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945024 00000100:00100000:3.0:1788619825.816137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945024 00000100:00100000:3.0:1788619825.816185:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788619825.816193:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676945024:12345-0@lo:503: 00000100:00100000:1.0:1788619825.816288:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619825.816375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676945024:12345-0@lo:503: Request processed in 183us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619825.816383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788619825.816925:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945024:0@lo:503: 00000100:00100000:3.0:1788619825.817306:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8470:1875503676945152:0@lo:502: 00000100:00100000:3.0:1788619825.817348:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.817406:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.817440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945152 00000100:00100000:0.0:1788619825.817445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945152 00000100:00100000:0.0:1788619825.817567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788619825.817575:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:8470:x1875503676945152:12345-0@lo:502: 00000100:00100000:0.0:1788619825.818171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:8470:x1875503676945152:12345-0@lo:502: Request processed in 596us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.818180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788619825.818239:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8470:1875503676945152:0@lo:502: 00000020:01000000:3.0:1788619825.818262:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619825.818270:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619825.818273:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788619825.818278:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788619825.818300:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8470:1875503676945280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619825.818330:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.818388:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.818421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945280 00000100:00100000:0.0:1788619825.818425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945280 00000100:00100000:0.0:1788619825.818524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788619825.818531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:8470:x1875503676945280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619825.818686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+14:8470:x1875503676945280:12345-0@lo:502:llog_process_th.0 Request processed in 155us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.818701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788619825.819266:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8470:1875503676945280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619825.819289:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619825.819300:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619825.819302:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788619825.819306:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788619825.819522:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788619825.819539:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788619825.819549:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.819560:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619825.819569:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788619825.819571:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333bbf76000 from 39 10000000:01000000:1.0:1788619825.819574:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788619825.819609:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.819622:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.819632:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.819941:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.819984:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.820017:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.820171:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945408 00000100:00100000:0.0:1788619825.820177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945408 00000100:00100000:0.0:1788619825.820240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788619825.820248:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:5837:x1875503676945408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619825.820257:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619825.820269:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031e00/0xbb0e330328bbe0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.820288:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031e00/0xbb0e330328bbe0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0c1 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.820299:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031e00/0xbb0e330328bbe0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0c1 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.820307:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031e00, rc 0) 00000100:00100000:0.0:1788619825.820345:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676945408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.820351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788619825.820406:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619825.820419:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.820427:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.820481:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.820511:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.820627:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619825.820660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945536 00000100:00100000:3.0:1788619825.820664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945536 00000100:00100000:3.0:1788619825.820682:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788619825.820688:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676945536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.820919:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676945536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619825.820926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788619825.820983:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.821010:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.821041:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.821068:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.821132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945664 00000100:00100000:2.0:1788619825.821136:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945664 00000100:00100000:2.0:1788619825.821163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788619825.821170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676945664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.821330:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676945664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.821336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788619825.821447:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676945664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.821892:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8471:1875503676945792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619825.821924:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.821982:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548000 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.822009:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945792 00000100:00100000:2.0:1788619825.822012:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945792 00000100:00100000:2.0:1788619825.822063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788619825.822069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:8471:x1875503676945792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.822232:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+15:8471:x1875503676945792:12345-0@lo:502:llog_process_th.0 Request processed in 162us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.822238:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788619825.822300:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8471:1875503676945792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619825.822336:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8471:1875503676945920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619825.822364:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619825.822454:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1788619825.822568:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676945920 00000100:00100000:3.0:1788619825.822573:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676945920 00000100:00100000:3.0:1788619825.822591:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788619825.822597:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:8471:x1875503676945920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619825.822724:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:8471:x1875503676945920:12345-0@lo:502:llog_process_th.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619825.822730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788619825.822804:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8471:1875503676945920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788619825.822823:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788619825.822952:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788619825.822968:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788619825.822976:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.822985:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619825.823004:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788619825.823007:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788619825.823009:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788619825.823029:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.823037:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.823045:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619825.823058:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.823083:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.823109:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.823152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946048 00000100:00100000:0.0:1788619825.823161:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946048 00000100:00100000:0.0:1788619825.823178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788619825.823183:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+15:5837:x1875503676946048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619825.823190:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619825.823201:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380030e00/0xbb0e330328bbe0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.823219:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380030e00/0xbb0e330328bbe0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.823228:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380030e00/0xbb0e330328bbe0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619825.823236:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030e00, rc 0) 00000100:00100000:0.0:1788619825.823268:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.823274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788619825.823323:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619825.823334:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.823342:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619825.823375:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.823396:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.823413:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.823445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946176 00000100:00100000:0.0:1788619825.823448:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946176 00000100:00100000:0.0:1788619825.823472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788619825.823477:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.823661:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.823668:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788619825.823802:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.823824:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.823858:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.823873:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.823919:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946304 00000100:00100000:0.0:1788619825.823923:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946304 00000100:00100000:0.0:1788619825.823939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788619825.823944:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.824071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.824077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788619825.824140:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.824729:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8472:1875503676946432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619825.824761:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.824862:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.824925:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946432 00000100:00100000:0.0:1788619825.824929:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946432 00000100:00100000:0.0:1788619825.824984:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788619825.824992:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:8472:x1875503676946432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619825.825139:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:8472:x1875503676946432:12345-0@lo:502:llog_process_th.0 Request processed in 148us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.825146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788619825.825200:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8472:1875503676946432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619825.825220:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619825.825227:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619825.825229:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788619825.825235:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788619825.825252:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8472:1875503676946560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619825.825278:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.825331:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.825381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946560 00000100:00100000:2.0:1788619825.825385:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946560 00000100:00100000:2.0:1788619825.825403:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788619825.825408:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:8472:x1875503676946560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.825554:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:8472:x1875503676946560:12345-0@lo:502:llog_process_th.0 Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.825561:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788619825.825663:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8472:1875503676946560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619825.825679:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619825.825683:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619825.825685:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788619825.825688:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788619825.825952:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788619825.825971:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788619825.825979:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.825989:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619825.826004:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788619825.826006:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93338a7b5000 from 39 10000000:01000000:2.0:1788619825.826009:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788619825.826031:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.826039:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.826048:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619825.826061:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.826086:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.826152:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.826262:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946688 00000100:00100000:1.0:1788619825.826272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946688 00000100:00100000:1.0:1788619825.826327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788619825.826334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676946688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619825.826342:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619825.826352:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18e000/0xbb0e330328bbe0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0dd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.826370:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18e000/0xbb0e330328bbe0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0dd expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.826379:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18e000/0xbb0e330328bbe0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0dd expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.826387:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18e000, rc 0) 00000100:00100000:1.0:1788619825.826421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676946688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619825.826427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788619825.826488:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788619825.826498:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.826506:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619825.826543:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.826564:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.826697:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.826762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946816 00000100:00100000:0.0:1788619825.826767:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946816 00000100:00100000:0.0:1788619825.826804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788619825.826809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676946816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.827010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676946816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.827018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788619825.828597:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.828647:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.828712:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.828887:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.831262:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676946944 00000100:00100000:0.0:1788619825.831275:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676946944 00000100:00100000:0.0:1788619825.831323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788619825.831331:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676946944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.831645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676946944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 314us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.831653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788619825.831817:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676946944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.832246:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8473:1875503676947072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619825.832287:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.832322:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.832360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947072 00000100:00100000:2.0:1788619825.832366:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947072 00000100:00100000:2.0:1788619825.832397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788619825.832404:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:8473:x1875503676947072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.832643:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:8473:x1875503676947072:12345-0@lo:502:llog_process_th.0 Request processed in 239us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.832650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788619825.832740:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8473:1875503676947072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619825.832806:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8473:1875503676947200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619825.832835:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.832849:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.832902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947200 00000100:00100000:2.0:1788619825.832906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947200 00000100:00100000:2.0:1788619825.832926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788619825.832931:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:8473:x1875503676947200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.833040:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:8473:x1875503676947200:12345-0@lo:502:llog_process_th.0 Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.833046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788619825.833148:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8473:1875503676947200:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788619825.833172:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788619825.833295:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788619825.833311:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788619825.833320:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.833331:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619825.833341:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788619825.833343:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788619825.833346:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788619825.833368:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.833380:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.833390:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619825.833404:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.833427:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.833453:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619825.834459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947328 00000100:00100000:3.0:1788619825.834469:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947328 00000100:00100000:3.0:1788619825.834520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788619825.834529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676947328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619825.834542:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619825.834632:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b31000/0xbb0e330328bbe0f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0eb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.834744:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b31000/0xbb0e330328bbe0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0eb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.834756:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b31000/0xbb0e330328bbe0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0eb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.834765:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31000, rc 0) 00000100:00100000:3.0:1788619825.834839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619825.834845:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788619825.834896:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619825.834912:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.834921:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.834976:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.835009:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.835039:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333875a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.835074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947456 00000100:00100000:0.0:1788619825.835078:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947456 00000100:00100000:0.0:1788619825.835113:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788619825.835129:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.835346:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619825.835352:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788619825.835408:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.835434:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.835537:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.835558:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333981810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.835594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947584 00000100:00100000:1.0:1788619825.835598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947584 00000100:00100000:1.0:1788619825.835625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788619825.835631:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.835759:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619825.835766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788619825.835851:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619825.836224:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8474:1875503676947712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.836258:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619825.836283:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.836316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947712 00000100:00100000:1.0:1788619825.836320:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947712 00000100:00100000:1.0:1788619825.836346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788619825.836352:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:8474:x1875503676947712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619825.836947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:8474:x1875503676947712:12345-0@lo:502:llog_process_th.0 Request processed in 592us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619825.836954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788619825.838492:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8474:1875503676947712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788619825.838536:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788619825.838546:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788619825.838550:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788619825.838556:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788619825.838591:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8474:1875503676947840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619825.838724:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.838831:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947840 00000100:00100000:1.0:1788619825.838843:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947840 00000100:00100000:2.0:1788619825.838854:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619825.838884:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788619825.838892:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:8474:x1875503676947840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619825.839109:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:8474:x1875503676947840:12345-0@lo:502:llog_process_th.0 Request processed in 216us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619825.839127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788619825.839149:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8474:1875503676947840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788619825.839173:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788619825.839178:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788619825.839180:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788619825.839185:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788619825.839404:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788619825.839425:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788619825.839433:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.839443:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619825.839452:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788619825.839454:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9333871319c0 from 1 10000000:01000000:1.0:1788619825.839457:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788619825.839544:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.839552:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619825.839561:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619825.839576:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788619825.839603:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619825.839631:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392fdd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788619825.840590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676947968 00000100:00100000:2.0:1788619825.840598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676947968 00000100:00100000:2.0:1788619825.840633:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788619825.840641:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676947968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788619825.840652:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619825.840664:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338a6ea600/0xbb0e330328bbe100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe0f9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.840685:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6ea600/0xbb0e330328bbe100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe0f9 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.840696:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338a6ea600/0xbb0e330328bbe100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe0f9 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619825.840705:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea600, rc 0) 00000100:00100000:2.0:1788619825.840759:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676947968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619825.840766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788619825.841179:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676947968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619825.841197:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.841205:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619825.841262:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676948096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619825.841290:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619825.841322:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619825.841369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948096 00000100:00100000:0.0:1788619825.841374:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948096 00000100:00100000:0.0:1788619825.841405:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788619825.841412:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676948096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619825.841682:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676948096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788619825.841690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788619825.841942:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676948096:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788619825.841965:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788619825.841970:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619825.841978:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619826.631766:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619827.399120:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676948480:0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.399195:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619827.399680:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676948352:0@lo:400:kworker.0 00000100:00100000:2.0:1788619827.399724:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619827.399821:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788619827.399829:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676948608:0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.399857:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619827.399924:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676948224:0@lo:400:kworker.0 00000100:00100000:1.0:1788619827.399958:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619827.406538:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948608 00000100:00100000:0.0:1788619827.406552:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948608 00000100:00100000:0.0:1788619827.406624:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788619827.406633:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676948608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.406735:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676948608:12345-0@lo:400:kworker.0 Request processed in 104us (6876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619827.406743:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788619827.406765:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788619827.406816:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333909db100 x1875503676948608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619827.406846:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676948608:0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.406917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948224 00000100:00100000:0.0:1788619827.406921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948224 00000100:00100000:0.0:1788619827.406946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788619827.406952:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676948224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.406981:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676948224:12345-0@lo:400:kworker.0 Request processed in 30us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619827.406987:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788619827.407027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948480 00000100:00100000:0.0:1788619827.407031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948480 00000100:00100000:0.0:1788619827.407065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948352 00000100:00100000:0.0:1788619827.407069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948352 00000100:00100000:0.0:1788619827.407093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788619827.407100:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.407140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676948480:12345-0@lo:400:kworker.0 Request processed in 41us (7946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619827.407146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788619827.407157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788619827.407162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676948352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.407184:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676948352:12345-0@lo:400:kworker.0 Request processed in 22us (7460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619827.407189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788619827.407203:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619827.407216:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676948480:0@lo:400:kworker.0 00000100:00100000:1.0:1788619827.411150:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676948224:0@lo:400:kworker.0 00000100:00100000:1.0:1788619827.411166:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676948736:0@lo:400:kworker.0 00000100:00100000:1.0:1788619827.411230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619827.411514:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948736 00000100:00100000:0.0:1788619827.411535:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948736 00000100:00100000:0.0:1788619827.411608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788619827.411618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676948736:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788619827.411758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619827.412760:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676948352:0@lo:400:kworker.0 00000100:00100000:2.0:1788619827.412789:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676948864:0@lo:400:kworker.0 00000100:00100000:2.0:1788619827.412839:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619827.415024:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948864 00000100:00100000:1.0:1788619827.415037:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948864 00000100:00100000:1.0:1788619827.415173:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788619827.415184:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676948864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619827.415260:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676948864:12345-0@lo:400:kworker.0 Request processed in 80us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619827.415267:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788619827.415344:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788619827.415383:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e7800 x1875503676948864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619827.418552:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676948864:0@lo:400:kworker.0 00000100:00100000:0.0:1788619827.420018:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676948736:12345-0@lo:400:kworker.0 Request processed in 8394us (8780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619827.420031:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788619827.420513:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676948736:0@lo:400:kworker.0 00010000:00010000:1.0:1788619827.655646:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619827.911984:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788619827.912007:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676948992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619827.912075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619827.912206:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676948992 00000100:00100000:1.0:1788619827.912214:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676948992 00000100:00100000:1.0:1788619827.912267:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788619827.912276:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676948992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619827.912314:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619827.912362:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676948992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619827.912369:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788619827.913209:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcce00 x1875503676948992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619827.913229:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676948992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619828.423228:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676949120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619828.423303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619828.423447:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949120 00000100:00100000:2.0:1788619828.423465:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949120 00000100:00100000:2.0:1788619828.423514:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788619828.423522:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676949120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619828.423555:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619828.423607:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676949120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619828.423615:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788619828.423897:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503676949120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619828.423915:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676949120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619828.679112:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619829.661980:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619829.662021:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619829.662074:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619829.662124:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619829.662203:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997632 00000100:00100000:1.0:1788619829.662213:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997632 00000100:00100000:1.0:1788619829.662271:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788619829.662289:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:2356:x1875503656997632:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788619829.662359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:2356:x1875503656997632:12345-192.168.203.12@tcp:400: Request processed in 72us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619829.662366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1788619829.662914:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997888 00000100:00100000:0.0:1788619829.662919:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997888 00000100:00100000:0.0:1788619829.662975:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998016 00000100:00100000:0.0:1788619829.662979:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998016 00000100:00100000:0.0:1788619829.662997:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788619829.663006:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656997888:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788619829.663043:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656997888:12345-192.168.203.12@tcp:400: Request processed in 38us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619829.663049:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788619829.663064:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788619829.663071:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656998016:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788619829.663107:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503656998016:12345-192.168.203.12@tcp:400: Request processed in 36us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619829.663113:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00080000:2.0:1788619829.663174:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619829.663179:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619829.663363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656997760 00000100:00100000:3.0:1788619829.663368:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656997760 00000100:00100000:3.0:1788619829.663418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788619829.663434:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503656997760:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788619829.663475:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503656997760:12345-192.168.203.12@tcp:400: Request processed in 50us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619829.663481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00080000:2.0:1788619829.663869:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788619829.703208:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619830.683983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619830.684135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998144 00000100:00100000:0.0:1788619830.684144:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998144 00000100:00100000:0.0:1788619830.684205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:0.0:1788619830.684215:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:5598:x1875503656998144:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788619830.684232:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619830.684258:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031600/0xbb0e330328bbe107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a7fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619830.684286:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031600/0xbb0e330328bbe107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7fe expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619830.684298:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031600/0xbb0e330328bbe107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7fe expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619830.684306:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031600, rc 0) 00000100:00100000:0.0:1788619830.684353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998144:12345-192.168.203.12@tcp:101: Request processed in 140us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619830.684360:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788619830.689835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619830.689961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998272 00000100:00100000:2.0:1788619830.689970:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998272 00000100:00100000:2.0:1788619830.690024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1788619830.690034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998272:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788619830.690355:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998272:12345-192.168.203.12@tcp:501: Request processed in 320us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619830.690364:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:1.0:1788619830.694360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619830.694698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998400 00000100:00100000:0.0:1788619830.694709:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998400 00000100:00100000:0.0:1788619830.694795:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1788619830.694805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998400:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1788619830.695038:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998400:12345-192.168.203.12@tcp:503: Request processed in 234us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619830.695299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1788619830.698361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619830.698670:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998528 00000100:00100000:1.0:1788619830.698680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998528 00000100:00100000:1.0:1788619830.698734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1788619830.698749:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:6096:x1875503656998528:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1788619830.699243:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:6096:x1875503656998528:12345-192.168.203.12@tcp:502: Request processed in 498us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619830.699253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1788619830.701230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619830.701462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998656 00000100:00100000:0.0:1788619830.701472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998656 00000100:00100000:0.0:1788619830.701606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:0.0:1788619830.701616:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:6096:x1875503656998656:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788619830.701934:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:6096:x1875503656998656:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 318us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619830.701943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1788619830.705487:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619830.705876:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998784 00000100:00100000:1.0:1788619830.705888:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998784 00000100:00100000:1.0:1788619830.706036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:1.0:1788619830.706045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656998784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619830.706063:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619830.706081:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18e400/0xbb0e330328bbe10e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a805 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619830.706121:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18e400/0xbb0e330328bbe10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a805 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619830.706130:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18e400/0xbb0e330328bbe10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a805 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619830.706157:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18e400, rc 0) 00000100:00100000:1.0:1788619830.706220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656998784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 176us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619830.706227:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1788619830.708361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619830.708431:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656998912 00000100:00100000:0.0:1788619830.708440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656998912 00000100:00100000:0.0:1788619830.708504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1788619830.708512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656998912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619830.708801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656998912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 288us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788619830.708810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00010000:00010000:1.0:1788619830.729894:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619831.752153:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788619832.003721:0:8513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef7c92980 20000000:00000080:2.0:1788619832.003736:0:8513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9332865f5400 uarg=0000000000000000 20000000:01000000:2.0:1788619832.004694:0:8513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788619832.004701:0:8513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788619832.004706:0:8513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788619832.005609:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788619832.005753:0:8513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788619832.012543:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788619832.012589:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788619832.012633:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788619832.012650:0:8513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788619832.012669:0:8513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012687:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012695:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012702:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012710:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012729:0:8513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012768:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012858:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 9 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.012873:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949248:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619832.012969:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.012978:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 18 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.012986:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949376:0@lo:104: 00000100:00100000:2.0:1788619832.013022:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619832.013102:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.013110:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 18 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.013239:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc044700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949504:0@lo:104: 00000100:00100000:2.0:1788619832.013264:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619832.029301:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619832.030381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999040 00000100:00100000:3.0:1788619832.030393:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999040 00010000:00010000:3.0:1788619832.030436:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 10 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619832.030479:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788619832.030489:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2355:x1875503656999040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619832.030502:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619832.030508:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 10 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619832.030535:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 10 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619832.030555:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619832.030610:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2355:x1875503656999040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 122us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619832.030617:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00010000:00010000:2.0:1788619832.030883:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.030905:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 18 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.030919:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949632:0@lo:104: 00000100:00100000:2.0:1788619832.030955:0:8513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788619832.030977:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7cd expref: 9 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.030990:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949248:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619832.031092:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788619832.031125:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.031136:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949376 00000100:00100000:1.0:1788619832.031139:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949376 00000100:00100000:1.0:1788619832.031160:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949504 00000100:00100000:1.0:1788619832.031162:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949504 00000100:00100000:1.0:1788619832.031171:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949632 00000100:00100000:1.0:1788619832.031173:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949632 00000100:00100000:1.0:1788619832.031195:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788619832.031202:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:8513:x1875503676949376:12345-0@lo:104: 00010000:00010000:1.0:1788619832.031213:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031265:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619832.031271:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:8513:x1875503676949376:12345-0@lo:104: Request processed in 70us (18249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.031277:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788619832.031291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788619832.031297:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:8513:x1875503676949504:12345-0@lo:104: 00010000:00010000:1.0:1788619832.031304:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031348:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788619832.031353:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:8513:x1875503676949504:12345-0@lo:104: Request processed in 57us (18088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.031359:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788619832.031387:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788619832.031393:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:8513:x1875503676949632:12345-0@lo:104: 00010000:00010000:1.0:1788619832.031400:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031429:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788619832.031434:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:8513:x1875503676949632:12345-0@lo:104: Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.031439:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788619832.031454:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788619832.031460:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031468:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619832.031472:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031481:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619832.031488:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619832.031494:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788619832.031523:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031530:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619832.031551:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031557:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813cfc00/0xbb0e330328bbdfb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdfb7 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031567:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788619832.031571:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031577:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619832.031580:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031586:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619832.031593:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619832.031598:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788619832.031609:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031614:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619832.031620:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031637:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbdf40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdf47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031646:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619832.031649:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031654:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfa00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619832.031657:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031664:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619832.031671:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619832.031676:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788619832.031688:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031693:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619832.031706:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031713:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813cfa00/0xbb0e330328bbded7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbdede expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.031725:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619832.031732:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619832.031734:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619832.031739:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619832.031751:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676949760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619832.031808:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.031835:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619832.031841:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676949888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619832.031863:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.031889:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676950016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619832.031909:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.031933:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949760 00000100:00100000:1.0:1788619832.031937:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949760 00010000:00010000:1.0:1788619832.031954:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 19 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619832.031972:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676949888 00000100:00100000:1.0:1788619832.031974:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676949888 00010000:00010000:1.0:1788619832.031986:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 20 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619832.031997:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950016 00000100:00100000:1.0:1788619832.031999:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950016 00010000:00010000:1.0:1788619832.032008:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 21 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619832.032020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619832.032026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+21:3311:x1875503676949760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619832.032035:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619832.032040:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 21 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032057:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 21 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032071:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619832.032112:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+21:3311:x1875503676949760:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.032119:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619832.032134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788619832.032140:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+20:3311:x1875503676949888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619832.032148:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619832.032152:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 20 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032161:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 20 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032170:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619832.032190:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+20:3311:x1875503676949888:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.032196:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788619832.032206:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788619832.032211:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676950016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619832.032218:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619832.032221:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 19 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032230:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 19 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032249:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032258:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032271:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032277:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032283:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032289:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032293:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eac00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788619832.032297:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032304:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032311:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.032320:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619832.032349:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676950016:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.032364:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788619832.032606:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619832.032808:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eae00/0xbb0e330328bbdfb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdfb0 expref: 18 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.032821:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949376:0@lo:104: 00010000:00010000:2.0:1788619832.032831:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eb000/0xbb0e330328bbdf47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbdf40 expref: 17 pid: 5833 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.032840:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc044700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949504:0@lo:104: 00010000:00010000:2.0:1788619832.032848:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813ce400/0xbb0e330328bbdede lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbded7 expref: 16 pid: 5834 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.032857:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875503676949632:0@lo:104: 00010000:00010000:2.0:1788619832.032880:0:8513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.032889:0:8513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.032895:0:8513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619832.032909:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eac00/0xbb0e330328bbe115 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619832.034008:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676949888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788619832.034020:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676949760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619832.034353:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676950016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788619832.373616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619832.373818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999168 00000100:00100000:1.0:1788619832.373829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999168 00000100:00100000:1.0:1788619832.373883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1788619832.373892:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:5598:x1875503656999168:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619832.373908:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619832.373926:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a80c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.373952:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.373962:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619832.373970:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fe00, rc 0) 00000100:00100000:1.0:1788619832.374015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656999168:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 124us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.374022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:3.0:1788619832.379241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619832.379353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999296 00000100:00100000:0.0:1788619832.379363:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999296 00000100:00100000:0.0:1788619832.379421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1788619832.379431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656999296:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619832.379713:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656999296:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619832.379720:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1788619832.383384:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619832.383481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999424 00000100:00100000:2.0:1788619832.383502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999424 00000100:00100000:2.0:1788619832.383556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1788619832.383566:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656999424:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619832.383815:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:5598:x1875503656999424:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 248us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619832.383824:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:3.0:1788619832.388598:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619832.390041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999552 00000100:00100000:1.0:1788619832.390054:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999552 00000100:00100000:1.0:1788619832.390128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1788619832.390139:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:6137:x1875503656999552:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788619832.390390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:6137:x1875503656999552:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 252us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.390408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:3.0:1788619832.395454:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619832.395656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999680 00000100:00100000:0.0:1788619832.395666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999680 00000100:00100000:0.0:1788619832.395744:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1788619832.395755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:6137:x1875503656999680:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788619832.396055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:6137:x1875503656999680:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 301us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619832.396063:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:3.0:1788619832.519798:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676950272:0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.519869:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619832.519933:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676950784:0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.519957:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619832.519984:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619832.519990:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676950400:0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.520011:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619832.520038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950272 00000100:00100000:3.0:1788619832.520045:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950272 00000100:00100000:3.0:1788619832.520091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950400 00000100:00100000:3.0:1788619832.520095:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950400 00000100:00100000:3.0:1788619832.520118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788619832.520126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676950272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.520175:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676950272:12345-0@lo:400:kworker.0 Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619832.520182:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788619832.520210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788619832.520216:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676950400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.520258:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676950400:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619832.520264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788619832.520298:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676950400:0@lo:400:kworker.0 00000100:00100000:3.0:1788619832.520308:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676950272:0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520440:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676950528:0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520468:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.520498:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788619832.520504:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676950144:0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.520552:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676950656:0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520578:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619832.520604:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950656 00000100:00100000:1.0:1788619832.520607:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950656 00000100:00100000:1.0:1788619832.520628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788619832.520634:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676950656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676950656:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.520671:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788619832.520695:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676950656:0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950144 00000100:00100000:1.0:1788619832.520714:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950144 00000100:00100000:1.0:1788619832.520735:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788619832.520742:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676950144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619832.520798:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676950144:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619832.520804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788619832.520836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676950144:0@lo:400:kworker.0 00000100:00080000:2.0:1788619832.520916:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619832.521050:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950784 00000100:00100000:0.0:1788619832.521055:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950784 00000100:00100000:0.0:1788619832.521110:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950528 00000100:00100000:0.0:1788619832.521114:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950528 00000100:00100000:0.0:1788619832.521131:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788619832.521137:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676950784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619832.521178:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676950784:12345-0@lo:400:kworker.0 Request processed in 40us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619832.521184:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788619832.521199:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788619832.521205:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676950528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788619832.521351:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619832.521355:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788619832.521403:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc044e00 x1875503676950784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619832.521415:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676950784:0@lo:400:kworker.0 00000100:00100000:0.0:1788619832.521489:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676950528:12345-0@lo:400:kworker.0 Request processed in 284us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619832.521496:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788619832.521595:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc046a00 x1875503676950528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619832.521606:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676950528:0@lo:400:kworker.0 00010000:00010000:1.0:1788619832.786936:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619833.031966:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619833.031986:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676950912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619833.032054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619833.032133:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676950912 00000100:00100000:1.0:1788619833.032140:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676950912 00000100:00100000:1.0:1788619833.032185:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788619833.032195:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676950912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619833.032234:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619833.032279:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676950912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.032287:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788619833.032326:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fce680 x1875503676950912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619833.032343:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676950912:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788619833.159953:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788619833.159962:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333861ca800 from 4 10000000:01000000:3.0:1788619833.159967:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788619833.160014:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619833.160025:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619833.160036:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619833.160062:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788619833.160143:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619833.160200:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.160273:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951040 00000100:00100000:0.0:1788619833.160282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951040 00000100:00100000:0.0:1788619833.160337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788619833.160346:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676951040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619833.160359:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619833.160372:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe123 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.160413:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.160424:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.160432:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031400, rc 0) 00000100:00100000:0.0:1788619833.160474:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.160481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788619833.160528:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619833.160544:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.160552:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619833.160607:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.160633:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.160654:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.160667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951168 00000100:00100000:0.0:1788619833.160671:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951168 00000100:00100000:0.0:1788619833.160707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788619833.160714:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.160986:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.161003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788619833.161036:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.161077:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.161117:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.161132:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.161144:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951296 00000100:00100000:0.0:1788619833.161148:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951296 00000100:00100000:0.0:1788619833.161170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788619833.161177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.161325:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.161331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788619833.161368:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.161567:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8543:1875503676951424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619833.161602:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.161621:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951424 00000100:00100000:0.0:1788619833.161624:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951424 00000100:00100000:0.0:1788619833.161646:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788619833.161652:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:8543:x1875503676951424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619833.164209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:8543:x1875503676951424:12345-0@lo:502:llog_process_th.0 Request processed in 2548us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.164676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788619833.164804:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.164831:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8543:1875503676951424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788619833.164874:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788619833.164883:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619833.164885:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788619833.164891:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333861ca800 00000020:00000080:0.0:1788619833.164894:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788619833.164977:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8543:1875503676951552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619833.165034:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.165059:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619833.169208:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951552 00000100:00100000:1.0:1788619833.169236:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951552 00000100:00100000:1.0:1788619833.169300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788619833.169311:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:8543:x1875503676951552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619833.169615:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:8543:x1875503676951552:12345-0@lo:502:llog_process_th.0 Request processed in 305us (4579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.169624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788619833.170282:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8543:1875503676951552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788619833.170332:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788619833.170341:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619833.170343:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788619833.170347:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788619833.170661:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788619833.170682:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788619833.170704:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619833.170730:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619833.170740:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788619833.170743:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bbf76000 from 4 10000000:01000000:1.0:1788619833.170746:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619833.170797:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619833.170806:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619833.170814:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619833.170835:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.170883:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619833.170912:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.171039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951680 00000100:00100000:0.0:1788619833.171045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951680 00000100:00100000:0.0:1788619833.171098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788619833.171106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676951680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619833.171117:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619833.171130:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe131 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.171151:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.171163:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.171172:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030000, rc 0) 00000100:00100000:0.0:1788619833.171206:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676951680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.171307:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619833.171335:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619833.171345:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619833.171396:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.171433:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619833.171456:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788619833.171471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951808 00000100:00100000:1.0:1788619833.171474:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951808 00000100:00100000:1.0:1788619833.171495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788619833.171501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676951808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.171925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676951808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.171933:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788619833.171970:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.171999:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.172039:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619833.172053:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788619833.172077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676951936 00000100:00100000:1.0:1788619833.172081:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676951936 00000100:00100000:1.0:1788619833.172100:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788619833.172106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676951936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619833.172307:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676951936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.172314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788619833.172492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788619833.172538:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619833.184158:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8545:1875503676952064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619833.185465:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619833.185515:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9332874066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619833.185890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952064 00000100:00100000:1.0:1788619833.185897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952064 00000100:00100000:1.0:1788619833.185952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788619833.185962:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:8545:x1875503676952064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619833.186194:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:8545:x1875503676952064:12345-0@lo:502:llog_process_th.0 Request processed in 233us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.186208:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788619833.186522:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8545:1875503676952064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619833.186557:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619833.186572:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619833.186575:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788619833.186583:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333bbf76000 00000020:00000080:3.0:1788619833.186586:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788619833.186657:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8545:1875503676952192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619833.187385:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619833.187486:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952192 00000100:00100000:3.0:1788619833.187492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952192 00000100:00100000:3.0:1788619833.187522:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788619833.187529:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:8545:x1875503676952192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619833.189163:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:8545:x1875503676952192:12345-0@lo:502:llog_process_th.0 Request processed in 1629us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619833.189173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788619833.189290:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9332874066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619833.189315:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8545:1875503676952192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619833.189497:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619833.189505:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619833.189507:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788619833.189513:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788619833.190501:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788619833.190525:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788619833.190537:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.190549:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619833.190558:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788619833.190561:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93338a7b5000 from 4 10000000:01000000:0.0:1788619833.190563:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788619833.190595:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.190603:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.190613:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619833.190633:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.191306:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.191811:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.191834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952320 00000100:00100000:0.0:1788619833.191842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952320 00000100:00100000:0.0:1788619833.191889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788619833.191898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676952320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619833.191912:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619833.191935:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe13f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.191958:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.191969:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.191979:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031c00, rc 0) 00000100:00100000:0.0:1788619833.192027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676952320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.192034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788619833.192106:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619833.192123:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.192132:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619833.192189:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.193306:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619833.193800:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788619833.194459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952448 00000100:00100000:2.0:1788619833.194469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952448 00000100:00100000:2.0:1788619833.194511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788619833.194528:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676952448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619833.194832:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676952448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619833.194840:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788619833.195269:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619833.195318:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619833.197648:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619833.198316:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.198521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952576 00000100:00100000:0.0:1788619833.198531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952576 00000100:00100000:0.0:1788619833.198583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788619833.198593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676952576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619833.199520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676952576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 925us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.199535:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788619833.199816:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676952576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619833.202048:0:8548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8548:1875503676952704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619833.202137:0:8548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619833.205441:0:8548:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440540 going to sleep for 11 seconds 00000100:00100000:0.0:1788619833.210727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952704 00000100:00100000:0.0:1788619833.210741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952704 00000100:00100000:0.0:1788619833.210807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788619833.210818:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:8548:x1875503676952704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619833.211128:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:8548:x1875503676952704:12345-0@lo:502:llog_process_th.0 Request processed in 250us (8929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619833.211137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788619833.213104:0:8548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8548:1875503676952704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619833.213149:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619833.213160:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619833.213162:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788619833.213171:0:8548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93338a7b5000 00000020:00000080:3.0:1788619833.213173:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788619833.213990:0:8548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8548:1875503676952832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619833.214062:0:8548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619833.214113:0:8548:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619833.219870:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952832 00000100:00100000:1.0:1788619833.219883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952832 00000100:00100000:1.0:1788619833.219952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788619833.219961:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:8548:x1875503676952832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619833.220222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:8548:x1875503676952832:12345-0@lo:502:llog_process_th.0 Request processed in 254us (6152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619833.220231:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788619833.221681:0:8548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:8548:1875503676952832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619833.221739:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619833.221762:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619833.221765:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788619833.221950:0:8548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788619833.222126:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788619833.222147:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788619833.222158:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619833.222178:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619833.547073:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676952960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619833.547144:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619833.547303:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676952960 00000100:00100000:3.0:1788619833.547311:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676952960 00000100:00100000:3.0:1788619833.547365:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788619833.547374:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676952960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619833.547407:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619833.547452:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676952960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619833.547459:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788619833.547496:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c6a00 x1875503676952960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619833.547513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676952960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788619833.801426:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619834.781971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619834.782003:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619834.782046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619834.782086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619834.782119:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000064 00000100:00100000:0.0:1788619834.782119:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000192 00000100:00100000:2.0:1788619834.782127:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000064 00000100:00100000:0.0:1788619834.782127:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000192 00000100:00100000:1.0:1788619834.782204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999936 00000100:00100000:1.0:1788619834.782209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999936 00000100:00100000:1.0:1788619834.782259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788619834.782269:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503656999936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619834.782339:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503656999936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619834.782347:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788619834.782894:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788619834.782904:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657000192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619834.782939:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657000192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619834.782961:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788619834.783165:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503656999808 00000100:00100000:3.0:1788619834.783171:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503656999808 00000100:00100000:3.0:1788619834.783235:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:3.0:1788619834.783243:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2357:x1875503656999808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619834.783273:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2357:x1875503656999808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619834.783279:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00080000:3.0:1788619834.783318:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788619834.783322:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788619834.783324:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619834.785538:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788619834.785557:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657000064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619834.785641:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657000064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (3553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619834.785649:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:1.0:1788619834.823177:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619835.848080:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619836.871400:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619837.640055:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676953216:0@lo:400:kworker.0 00000100:00100000:0.0:1788619837.640122:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619837.640164:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676953728:0@lo:400:kworker.0 00000100:00100000:0.0:1788619837.640187:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619837.640216:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619837.640221:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676953344:0@lo:400:kworker.0 00000100:00100000:2.0:1788619837.640548:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676953472:0@lo:400:kworker.0 00000100:00100000:2.0:1788619837.640588:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619837.640616:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619837.640622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676953088:0@lo:400:kworker.0 00000100:00100000:2.0:1788619837.640649:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619837.640671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676953600:0@lo:400:kworker.0 00000100:00100000:2.0:1788619837.640690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619837.640817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619837.641003:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953728 00000100:00100000:1.0:1788619837.641012:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953728 00000100:00100000:1.0:1788619837.641074:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953472 00000100:00100000:1.0:1788619837.641077:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953472 00000100:00100000:1.0:1788619837.641095:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788619837.641104:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676953728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.641156:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676953728:12345-0@lo:400:kworker.0 Request processed in 53us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619837.641163:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788619837.641186:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619837.641192:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676953472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.641225:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676953472:12345-0@lo:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619837.641231:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619837.641246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953216 00000100:00100000:1.0:1788619837.641249:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953216 00000100:00100000:1.0:1788619837.641265:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953600 00000100:00100000:1.0:1788619837.641268:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953600 00000100:00100000:1.0:1788619837.641279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953344 00000100:00100000:1.0:1788619837.641281:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953344 00000100:00100000:1.0:1788619837.641293:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788619837.641299:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676953216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619837.641375:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788619837.641383:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1788619837.641494:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e4a80 x1875503676953728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619837.641508:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676953728:0@lo:400:kworker.0 00000100:00100000:0.0:1788619837.641546:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788619837.641553:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676953600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.641656:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676953216:12345-0@lo:400:kworker.0 Request processed in 356us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619837.641662:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788619837.641674:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788619837.641680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788619837.641685:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676953344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.641713:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676953344:12345-0@lo:400:kworker.0 Request processed in 28us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619837.641718:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788619837.641733:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788619837.641737:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619837.641739:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788619837.641756:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676953344:0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.641766:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676953216:0@lo:400:kworker.0 00010000:00080000:1.0:1788619837.641832:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e6680 x1875503676953472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619837.641841:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676953472:0@lo:400:kworker.0 00000100:00100000:3.0:1788619837.642063:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953088 00000100:00100000:3.0:1788619837.642073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953088 00000100:00100000:3.0:1788619837.642110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788619837.642117:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676953088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619837.642158:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676953088:12345-0@lo:400:kworker.0 Request processed in 42us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619837.642164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788619837.642197:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676953088:0@lo:400:kworker.0 00000100:00100000:1.0:1788619837.642500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676953600:12345-0@lo:400:kworker.0 Request processed in 947us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619837.642506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788619837.644274:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676953600:0@lo:400:kworker.0 00010000:00010000:2.0:1788619837.895957:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619838.161669:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619838.161690:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676953856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619838.161757:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619838.161833:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953856 00000100:00100000:1.0:1788619838.161840:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953856 00000100:00100000:1.0:1788619838.161883:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788619838.161892:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676953856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619838.161926:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619838.161970:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676953856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619838.161977:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788619838.162017:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fce680 x1875503676953856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619838.162047:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676953856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619838.667014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676953984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619838.667107:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619838.669457:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676953984 00000100:00100000:0.0:1788619838.669471:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676953984 00000100:00100000:0.0:1788619838.669540:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788619838.669561:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676953984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619838.669599:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619838.669700:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676953984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619838.669708:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788619838.669755:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e4a80 x1875503676953984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619838.669816:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676953984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619838.919065:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619839.872469:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788619839.902918:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619839.902960:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619839.903250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000320 00000100:00100000:0.0:1788619839.903261:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000320 00000100:00100000:0.0:1788619839.903316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788619839.903325:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503657000320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619839.903387:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503657000320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619839.903394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788619839.907209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000448 00000100:00100000:2.0:1788619839.907222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000448 00000100:00100000:2.0:1788619839.907286:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788619839.907295:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657000448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619839.907366:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657000448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (4406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619839.907373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00080000:1.0:1788619839.907596:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619839.922172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619839.922271:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619839.922629:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000576 00000100:00100000:1.0:1788619839.922640:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000576 00000100:00100000:0.0:1788619839.922861:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000704 00000100:00100000:0.0:1788619839.922866:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000704 00000100:00100000:1.0:1788619839.922956:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788619839.922966:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2353:x1875503657000576:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1788619839.922999:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe082 00000100:00080000:1.0:1788619839.923008:0:6689:0:(import.c:65:import_set_state_nolock()) ffff933387161800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788619839.923054:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788619839.923448:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+2:2353:x1875503657000576:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 482us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619839.923457:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:1.0:1788619839.926921:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788619839.927439:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619839.927445:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619839.932741:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788619839.932756:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2353:x1875503657000704:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1788619839.933392:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe089 00000100:00080000:0.0:1788619839.933406:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9332849a6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788619839.933446:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788619839.933923:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+2:2353:x1875503657000704:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 1168us (11648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619839.933932:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:0.0:1788619839.934365:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619839.946207:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619840.968029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619841.991399:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619842.759128:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676954112:0@lo:400:kworker.0 00000100:00100000:2.0:1788619842.759208:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619842.759241:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954112 00000100:00100000:1.0:1788619842.759251:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954112 00000100:00100000:1.0:1788619842.759309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788619842.759318:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676954112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.759377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676954112:12345-0@lo:400:kworker.0 Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619842.759385:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788619842.759554:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676954112:0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.759846:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676954240:0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.759883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619842.759912:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619842.759918:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676954368:0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.759943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619842.759975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954240 00000100:00100000:1.0:1788619842.759986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954240 00000100:00100000:1.0:1788619842.760027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954368 00000100:00100000:1.0:1788619842.760030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954368 00000100:00100000:1.0:1788619842.760056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788619842.760061:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676954240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.760098:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676954240:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619842.760104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788619842.760118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788619842.760123:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676954368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.760145:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619842.760147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676954368:12345-0@lo:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619842.760152:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788619842.760171:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619842.760194:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676954368:0@lo:400:kworker.0 00000100:00100000:1.0:1788619842.760204:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676954240:0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.760617:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676954752:0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.760653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619842.760698:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676954496:0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.760720:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619842.761322:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788619842.761331:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676954624:0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.761359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619842.761542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954624 00000100:00100000:2.0:1788619842.761549:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954624 00000100:00080000:0.0:1788619842.761615:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619842.761654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788619842.761662:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676954624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619842.761709:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676954624:12345-0@lo:400:kworker.0 Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619842.761727:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788619842.762296:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954752 00000100:00100000:3.0:1788619842.762303:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954752 00000100:00100000:3.0:1788619842.762342:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954496 00000100:00100000:3.0:1788619842.762345:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954496 00000100:00100000:0.0:1788619842.762346:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676954624:0@lo:400:kworker.0 00000100:00100000:3.0:1788619842.762361:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788619842.762367:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676954752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619842.762371:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788619842.762377:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788619842.762412:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676954752:12345-0@lo:400:kworker.0 Request processed in 46us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619842.762418:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788619842.762429:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788619842.762435:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676954496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619842.762463:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676954496:12345-0@lo:400:kworker.0 Request processed in 28us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619842.762468:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788619842.762481:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e6680 x1875503676954752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619842.762490:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676954752:0@lo:400:kworker.0 00010000:00080000:0.0:1788619842.762512:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e7b80 x1875503676954496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619842.762520:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676954496:0@lo:400:kworker.0 00000100:00080000:2.0:1788619842.762664:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619842.762667:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788619843.018364:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619843.273183:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619843.273204:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676954880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619843.273664:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619843.274300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676954880 00000100:00100000:0.0:1788619843.274309:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676954880 00000100:00100000:0.0:1788619843.274363:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788619843.274372:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676954880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619843.274403:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619843.274463:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676954880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619843.274471:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788619843.274704:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc045f80 x1875503676954880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619843.274723:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676954880:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788619843.342019:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:2.0:1788619843.342027:0:7649:0:(genops.c:885:class_export_put()) final put ffff9332849a1000/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:2.0:1788619843.342840:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a1000/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-OST0001 00000020:00000080:2.0:1788619843.342885:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9332849a6800 for lustre-OST0001 00000100:00100000:2.0:1788619843.783431:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619843.783498:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619843.784368:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955008 00000100:00100000:1.0:1788619843.784378:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955008 00000100:00100000:1.0:1788619843.784433:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788619843.784443:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676955008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788619843.784478:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619843.784531:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676955008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619843.784537:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788619843.784902:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcc700 x1875503676955008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619843.784919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676955008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619844.039327:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788619844.885253:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:2.0:1788619844.885263:0:6720:0:(genops.c:885:class_export_put()) final put ffff933387166800/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:3.0:1788619844.885326:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933387166800/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-OST0000 00000020:00000080:3.0:1788619844.885387:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933387161800 for lustre-OST0000 00000001:02000400:3.0:1788619845.016050:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00000100:00100000:3.0:1788619845.031893:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619845.031939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619845.031970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000832 00000100:00100000:3.0:1788619845.031980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000832 00000100:00100000:3.0:1788619845.032045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1788619845.032056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657000832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619845.032137:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657000832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619845.032145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1788619845.032181:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657000960 00000100:00100000:3.0:1788619845.032185:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657000960 00000100:00100000:3.0:1788619845.032230:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788619845.032238:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657000960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619845.035433:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657000960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3187us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619845.035446:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00080000:2.0:1788619845.036926:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788619845.063727:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619846.086937:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619847.111165:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619847.879193:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676955392:0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.879266:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619847.879339:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788619847.879346:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676955264:0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.879387:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619847.879405:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676955776:0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.879427:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619847.879461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955392 00000100:00100000:3.0:1788619847.879468:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955392 00000100:00100000:3.0:1788619847.879522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955264 00000100:00100000:3.0:1788619847.879526:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955264 00000100:00100000:3.0:1788619847.879547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788619847.879554:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676955392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.879604:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676955392:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619847.879622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788619847.879638:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788619847.879799:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676955520:0@lo:400:kworker.0 00000100:00100000:2.0:1788619847.879829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619847.879847:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619847.879853:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676955136:0@lo:400:kworker.0 00000100:00100000:2.0:1788619847.879875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619847.879894:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676955648:0@lo:400:kworker.0 00000100:00100000:2.0:1788619847.879913:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788619847.879938:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619847.879974:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955648 00000100:00100000:2.0:1788619847.879978:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955648 00000100:00100000:3.0:1788619847.880210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676955264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.880243:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676955264:12345-0@lo:400:kworker.0 Request processed in 36us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619847.880301:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955776 00000100:00100000:0.0:1788619847.880314:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955776 00000100:00100000:0.0:1788619847.880347:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955520 00000100:00100000:0.0:1788619847.880349:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955520 00000100:00100000:0.0:1788619847.880371:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788619847.880378:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676955776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619847.880414:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676955776:12345-0@lo:400:kworker.0 Request processed in 37us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619847.880419:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788619847.880432:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788619847.880437:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676955520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619847.880467:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676955520:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619847.880473:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788619847.880492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955136 00000100:00100000:0.0:1788619847.880495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955136 00000100:00100000:0.0:1788619847.880518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788619847.880525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676955136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619847.880551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676955136:12345-0@lo:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619847.880556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788619847.880607:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676955136:0@lo:400:kworker.0 00010000:00080000:0.0:1788619847.880621:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715dc00 x1875503676955520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619847.880632:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676955520:0@lo:400:kworker.0 00000100:00080000:0.0:1788619847.880696:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788619847.880699:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619847.880701:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619847.880730:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676955264:0@lo:400:kworker.0 00010000:00080000:0.0:1788619847.880739:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715ce00 x1875503676955776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619847.880748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676955776:0@lo:400:kworker.0 00000100:00100000:0.0:1788619847.880759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676955392:0@lo:400:kworker.0 00000100:00100000:2.0:1788619847.881445:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788619847.881458:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676955648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619847.881523:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676955648:12345-0@lo:400:kworker.0 Request processed in 69us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619847.881529:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788619847.881592:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676955648:0@lo:400:kworker.0 00000100:00100000:3.0:1788619847.881756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1788619848.135015:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619848.393295:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619848.393381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619848.393592:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676955904 00000100:00100000:2.0:1788619848.393599:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676955904 00000100:00100000:2.0:1788619848.393649:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788619848.393659:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676955904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619848.393690:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619848.393735:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676955904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619848.393742:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788619848.396532:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcc700 x1875503676955904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619848.396558:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619848.903464:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619848.903486:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676956032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619848.903559:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619848.903832:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956032 00000100:00100000:3.0:1788619848.903840:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956032 00000100:00100000:3.0:1788619848.903941:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788619848.903952:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676956032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619848.903998:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619848.904055:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676956032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619848.904062:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788619848.904139:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e6680 x1875503676956032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619848.904158:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676956032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619849.159009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619850.079879:0:9254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788619850.140028:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619850.140075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619850.140121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001216 00000100:00100000:2.0:1788619850.140130:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001216 00000100:00100000:2.0:1788619850.140209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788619850.140220:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657001216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619850.140285:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657001216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619850.140303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00080000:2.0:1788619850.140325:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619850.140371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001088 00000100:00100000:3.0:1788619850.140376:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001088 00000100:00100000:3.0:1788619850.140415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1788619850.140423:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619850.140450:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619850.140457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00010000:00010000:0.0:1788619850.185265:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619851.212027:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619852.235903:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619852.558419:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00000100:00100000:0.0:1788619853.004075:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676956416:0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619853.004253:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788619853.004260:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676956288:0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004284:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619853.004330:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676956800:0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004368:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619853.004414:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956416 00000100:00100000:0.0:1788619853.004421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956416 00000100:00100000:0.0:1788619853.004484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956288 00000100:00100000:0.0:1788619853.004487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956288 00000100:00100000:0.0:1788619853.004510:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788619853.004523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676956416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004571:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676956416:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619853.004578:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788619853.004606:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788619853.004613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676956288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004640:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676956288:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619853.004645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788619853.004664:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956800 00000100:00100000:0.0:1788619853.004667:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956800 00000100:00100000:0.0:1788619853.004694:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788619853.004700:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676956800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004728:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676956800:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619853.004734:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788619853.004749:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619853.004754:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619853.004811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676956288:0@lo:400:kworker.0 00010000:00080000:0.0:1788619853.004824:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715ce00 x1875503676956800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619853.004842:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676956800:0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.004854:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676956416:0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.004964:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676956160:0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005001:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619853.005031:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676956672:0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005053:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619853.005094:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619853.005101:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676956544:0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619853.005151:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956672 00000100:00100000:2.0:1788619853.005155:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956672 00000100:00100000:2.0:1788619853.005187:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788619853.005194:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676956672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005228:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676956672:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619853.005234:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788619853.005252:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956544 00000100:00100000:2.0:1788619853.005255:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956544 00000100:00100000:2.0:1788619853.005278:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788619853.005284:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005312:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676956544:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619853.005318:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788619853.005333:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619853.005336:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788619853.005351:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e4a80 x1875503676956544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619853.005368:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676956544:0@lo:400:kworker.0 00000100:00100000:2.0:1788619853.005381:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676956672:0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.005884:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956160 00000100:00100000:0.0:1788619853.005889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956160 00000100:00100000:0.0:1788619853.005926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788619853.005948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619853.005998:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676956160:12345-0@lo:400:kworker.0 Request processed in 51us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619853.006003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788619853.006345:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676956160:0@lo:400:kworker.0 00010000:00010000:1.0:1788619853.263719:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619853.513862:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619853.513884:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676956928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619853.513959:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619853.514015:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676956928 00000100:00100000:1.0:1788619853.514022:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676956928 00000100:00100000:1.0:1788619853.514063:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788619853.514072:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676956928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619853.514102:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619853.514143:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676956928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619853.514149:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788619853.514187:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387fcc700 x1875503676956928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619853.514203:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676956928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619854.023119:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619854.023143:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676957056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619854.023211:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619854.023343:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957056 00000100:00100000:3.0:1788619854.023352:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957056 00000100:00100000:3.0:1788619854.023403:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788619854.023412:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676957056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619854.023448:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619854.023496:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676957056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619854.023503:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788619854.023622:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503676957056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619854.023641:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676957056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619854.278910:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619855.140354:0:9450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:3.0:1788619855.267970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619855.268016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001344 00000100:00100000:2.0:1788619855.268027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001344 00000100:00100000:2.0:1788619855.268086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788619855.268097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619855.268177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619855.268184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788619855.268244:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619855.268321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001472 00000100:00100000:0.0:1788619855.268327:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001472 00000100:00100000:0.0:1788619855.268373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788619855.268381:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657001472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619855.268415:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657001472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619855.268422:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00080000:0.0:1788619855.268439:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788619855.310342:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619856.331359:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619857.352622:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619857.385263:0:9498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 10:50:56 EDT 2026 00000100:00100000:1.0:1788619858.119191:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676957568:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119281:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619858.119354:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788619858.119362:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676957184:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119391:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619858.119413:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676957696:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619858.119473:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676957312:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619858.119513:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676957824:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619858.119549:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619858.119555:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676957440:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.119586:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619858.119680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957184 00000100:00100000:3.0:1788619858.119688:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957184 00000100:00100000:3.0:1788619858.119742:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788619858.119752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676957184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619858.119828:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676957184:12345-0@lo:400:kworker.0 Request processed in 79us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619858.119835:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788619858.119963:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676957184:0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.121821:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957696 00000100:00100000:1.0:1788619858.121834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957696 00000100:00100000:3.0:1788619858.121957:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957568 00000100:00100000:3.0:1788619858.121962:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957568 00000100:00100000:1.0:1788619858.122029:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957312 00000100:00100000:1.0:1788619858.122034:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957312 00000100:00100000:1.0:1788619858.122048:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957440 00000100:00100000:1.0:1788619858.122052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957440 00000100:00100000:2.0:1788619858.122496:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788619858.122510:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676957696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619858.122676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676957696:12345-0@lo:400:kworker.0 Request processed in 166us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619858.122684:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788619858.122717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788619858.122724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676957312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619858.122763:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676957312:12345-0@lo:400:kworker.0 Request processed in 40us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619858.122787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788619858.122972:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676957696:0@lo:400:kworker.0 00000100:00100000:3.0:1788619858.123077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957824 00000100:00100000:3.0:1788619858.123082:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957824 00000100:00100000:3.0:1788619858.123107:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788619858.123114:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619858.123392:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676957568:12345-0@lo:400:kworker.0 Request processed in 277us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619858.123400:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788619858.123415:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788619858.123498:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676957824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619858.123532:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676957824:12345-0@lo:400:kworker.0 Request processed in 38us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619858.123539:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788619858.123651:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676957312:0@lo:400:kworker.0 00010000:00080000:3.0:1788619858.123666:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338703a300 x1875503676957824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619858.123677:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676957824:0@lo:400:kworker.0 00010000:00080000:2.0:1788619858.123921:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387039180 x1875503676957568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619858.123934:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676957568:0@lo:400:kworker.0 00000100:00080000:0.0:1788619858.124036:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619858.124041:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788619858.124043:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619858.124174:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788619858.124182:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619858.124233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676957440:12345-0@lo:400:kworker.0 Request processed in 52us (4647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619858.124240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788619858.124533:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676957440:0@lo:400:kworker.0 00010000:00010000:0.0:1788619858.375930:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619858.631810:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619858.631929:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619858.632452:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676957952 00000100:00100000:0.0:1788619858.632460:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676957952 00000100:00100000:0.0:1788619858.632505:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788619858.632528:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676957952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619858.632562:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619858.632622:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676957952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619858.632629:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788619858.632667:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb922300 x1875503676957952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619858.632684:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619859.143294:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619859.143319:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676958080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619859.143386:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619859.143445:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958080 00000100:00100000:0.0:1788619859.143452:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958080 00000100:00100000:0.0:1788619859.143497:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788619859.143505:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676958080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619859.143552:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619859.143594:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676958080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619859.143601:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788619859.143640:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503676958080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619859.143658:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676958080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619859.400921:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619860.379788:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619860.379836:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619860.379870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001728 00000100:00100000:3.0:1788619860.379892:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001728 00000100:00100000:3.0:1788619860.379956:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788619860.379965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657001728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619860.380181:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657001728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 216us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619860.380190:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00080000:3.0:1788619860.380213:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619860.380569:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001600 00000100:00100000:0.0:1788619860.380575:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001600 00000100:00100000:0.0:1788619860.380635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1788619860.380645:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619860.380680:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657001600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619860.380687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00010000:00010000:1.0:1788619860.422990:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619861.451294:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619862.476882:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619863.240258:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676958208:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240367:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240430:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676958720:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240492:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619863.240498:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676958592:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240521:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240552:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676958336:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240576:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240594:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676958848:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240631:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619863.240636:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676958464:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240655:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619863.240700:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958720 00000100:00100000:2.0:1788619863.240708:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958720 00000100:00100000:2.0:1788619863.240766:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958336 00000100:00100000:2.0:1788619863.240798:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958336 00000100:00100000:2.0:1788619863.240812:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958464 00000100:00100000:2.0:1788619863.240814:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958464 00000100:00100000:2.0:1788619863.240831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788619863.240840:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676958720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240908:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676958720:12345-0@lo:400:kworker.0 Request processed in 69us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619863.240916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788619863.240935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788619863.240942:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676958336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.240973:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676958336:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619863.240978:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788619863.240989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788619863.240995:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676958464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.241017:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676958464:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619863.241023:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788619863.241043:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958592 00000100:00100000:2.0:1788619863.241046:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958592 00000100:00100000:2.0:1788619863.241074:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958848 00000100:00100000:2.0:1788619863.241076:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958848 00000100:00100000:2.0:1788619863.241097:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788619863.241103:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676958592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.241133:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676958592:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619863.241145:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788619863.241157:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788619863.241162:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676958848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.241192:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676958848:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619863.241197:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788619863.241225:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619863.241229:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619863.241232:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619863.241275:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676958464:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.241287:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676958336:0@lo:400:kworker.0 00010000:00080000:2.0:1788619863.241299:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc454e00 x1875503676958848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619863.241310:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676958848:0@lo:400:kworker.0 00010000:00080000:2.0:1788619863.241347:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc455880 x1875503676958592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619863.241355:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676958592:0@lo:400:kworker.0 00000100:00100000:2.0:1788619863.241364:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676958720:0@lo:400:kworker.0 00000100:00100000:3.0:1788619863.241530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958208 00000100:00100000:3.0:1788619863.241535:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958208 00000100:00100000:3.0:1788619863.241580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788619863.241588:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676958208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619863.241641:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676958208:12345-0@lo:400:kworker.0 Request processed in 54us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619863.241648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788619863.241687:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676958208:0@lo:400:kworker.0 00010000:00010000:1.0:1788619863.494992:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619863.757277:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676958976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619863.757380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619863.757586:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676958976 00000100:00100000:1.0:1788619863.757597:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676958976 00000100:00100000:1.0:1788619863.757669:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788619863.757681:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676958976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619863.757731:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619863.757818:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676958976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619863.757826:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788619863.757936:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb921c00 x1875503676958976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619863.757959:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676958976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619864.267632:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676959104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619864.267727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619864.267820:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959104 00000100:00100000:1.0:1788619864.267833:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959104 00000100:00100000:1.0:1788619864.268100:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788619864.268111:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676959104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788619864.268157:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619864.268222:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676959104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619864.268229:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788619864.268297:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb920380 x1875503676959104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619864.268317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676959104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619864.519029:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619865.501042:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619865.501093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619865.501185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001984 00000100:00100000:2.0:1788619865.501198:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001984 00000100:00100000:2.0:1788619865.501303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788619865.501316:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657001984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619865.501416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657001984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 102us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619865.501424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00080000:0.0:1788619865.502154:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619865.502550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657001856 00000100:00100000:3.0:1788619865.502561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657001856 00000100:00100000:3.0:1788619865.502618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1788619865.502628:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2355:x1875503657001856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619865.502724:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2355:x1875503657001856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 97us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619865.502732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00010000:00010000:0.0:1788619865.543095:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619866.571864:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619867.591235:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619868.360165:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676959232:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360241:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360310:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676959744:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360341:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360368:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619868.360374:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676959616:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360399:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959744 00000100:00100000:0.0:1788619868.360437:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959744 00000100:00100000:0.0:1788619868.360487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788619868.360496:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676959744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619868.360608:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676959360:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676959744:12345-0@lo:400:kworker.0 Request processed in 208us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619868.360713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788619868.360742:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676959872:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959360 00000100:00100000:0.0:1788619868.360752:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959360 00000100:00100000:2.0:1788619868.360790:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360801:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788619868.360809:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676959360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619868.360814:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619868.360834:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676959488:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360860:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676959360:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619868.360868:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619868.360873:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788619868.360888:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959488 00000100:00100000:0.0:1788619868.360891:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959488 00000100:00100000:2.0:1788619868.360899:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676959360:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788619868.360918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676959488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.360949:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676959488:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619868.360954:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788619868.360974:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959616 00000100:00100000:0.0:1788619868.360977:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959616 00000100:00100000:0.0:1788619868.361000:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959872 00000100:00100000:0.0:1788619868.361003:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959872 00000100:00100000:0.0:1788619868.361022:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788619868.361029:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676959616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619868.361175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676959232 00000100:00100000:3.0:1788619868.361180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676959232 00000100:00100000:3.0:1788619868.361208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788619868.361214:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676959232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619868.361248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676959232:12345-0@lo:400:kworker.0 Request processed in 35us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619868.361254:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788619868.361462:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676959616:12345-0@lo:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619868.361472:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676959488:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.361474:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788619868.361498:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788619868.361506:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676959872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.361557:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676959872:12345-0@lo:400:kworker.0 Request processed in 53us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619868.361563:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788619868.361583:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619868.361588:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788619868.361591:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788619868.361617:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc456300 x1875503676959616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619868.361628:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676959616:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.361637:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676959232:0@lo:400:kworker.0 00000100:00100000:0.0:1788619868.361646:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676959744:0@lo:400:kworker.0 00010000:00080000:3.0:1788619868.362188:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc457480 x1875503676959872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619868.362200:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676959872:0@lo:400:kworker.0 00010000:00010000:1.0:1788619868.616125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619868.876841:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676960000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619868.876906:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619868.878140:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960000 00000100:00100000:3.0:1788619868.878156:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960000 00000100:00100000:3.0:1788619868.878206:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788619868.878215:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676960000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788619868.878248:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619868.878314:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676960000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619868.878321:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788619868.878364:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb923480 x1875503676960000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619868.878382:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676960000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619869.382902:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676960128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619869.382965:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619869.383033:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960128 00000100:00100000:0.0:1788619869.383040:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960128 00000100:00100000:0.0:1788619869.383082:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788619869.383092:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676960128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619869.383125:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619869.383166:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676960128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619869.383174:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788619869.383219:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb6e4a80 x1875503676960128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619869.383237:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676960128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619869.638987:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619870.627702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619870.627821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619870.628169:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002240 00000100:00100000:2.0:1788619870.628187:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002240 00000100:00100000:2.0:1788619870.628291:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788619870.628304:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657002240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788619870.628558:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619870.628678:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657002240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 375us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619870.628688:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788619870.630682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002112 00000100:00100000:3.0:1788619870.630703:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002112 00000100:00100000:3.0:1788619870.630903:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1788619870.635279:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503657002112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619870.635420:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2356:x1875503657002112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 4506us (7646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619870.635433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00010000:00010000:0.0:1788619870.663195:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619871.687157:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788619872.587271:0:10128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:51:11 (1788619871) === 00010000:00010000:1.0:1788619872.710898:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619873.006716:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619873.006892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002368 00000100:00100000:3.0:1788619873.006902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002368 00000100:00100000:3.0:1788619873.006955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:3.0:1788619873.006965:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:8155:x1875503657002368:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788619873.006981:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619873.006998:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a813 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619873.007027:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a813 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619873.007040:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a813 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619873.007049:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30a00, rc 0) 00000100:00100000:3.0:1788619873.007123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657002368:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 159us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.007131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:0.0:1788619873.014921:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.015015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002496 00000100:00100000:1.0:1788619873.015024:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002496 00000100:00100000:1.0:1788619873.015079:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:1.0:1788619873.015099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657002496:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788619873.015479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657002496:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 389us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.015488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:0.0:1788619873.021929:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619873.022020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002624 00000100:00100000:2.0:1788619873.022031:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002624 00000100:00100000:2.0:1788619873.022097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1788619873.022108:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657002624:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788619873.022336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657002624:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 228us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.022344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:0.0:1788619873.027809:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.027964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002752 00000100:00100000:1.0:1788619873.027974:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002752 00000100:00100000:1.0:1788619873.028087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1788619873.028098:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8159:x1875503657002752:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788619873.028362:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8159:x1875503657002752:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 264us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.028370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1788619873.057530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619873.057654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657002880 00000100:00100000:3.0:1788619873.057666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657002880 00000100:00100000:3.0:1788619873.057724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:3.0:1788619873.057735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8159:x1875503657002880:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788619873.058650:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8159:x1875503657002880:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 913us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.058660:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788619873.069896:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.072747:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003008 00000100:00100000:1.0:1788619873.072762:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003008 00000100:00100000:1.0:1788619873.072947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:1.0:1788619873.072959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:8155:x1875503657003008:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788619873.072991:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619873.073010:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18ea00/0xbb0e330328bbe154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a83d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.073041:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18ea00/0xbb0e330328bbe154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a83d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.073053:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18ea00/0xbb0e330328bbe154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a83d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.073082:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18ea00, rc 0) 00000100:00100000:1.0:1788619873.073149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:8155:x1875503657003008:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 192us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.073156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1788619873.080092:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619873.080194:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003136 00000100:00100000:3.0:1788619873.080207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003136 00000100:00100000:3.0:1788619873.080279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:3.0:1788619873.080290:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:8155:x1875503657003136:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788619873.080329:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788619873.080364:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788619873.080368:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788619873.080372:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788619873.080374:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788619873.085232:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:8155:x1875503657003136:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 4933us (5141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.085246:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1788619873.098529:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.098821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003264 00000100:00100000:1.0:1788619873.098831:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003264 00000100:00100000:1.0:1788619873.098889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1788619873.098900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:8155:x1875503657003264:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788619873.098917:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619873.098935:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a844 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.098964:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.098986:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619873.098996:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18f000, rc 0) 00000100:00100000:1.0:1788619873.099052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8155:x1875503657003264:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 154us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.099059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1788619873.101086:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619873.101305:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003392 00000100:00100000:2.0:1788619873.101317:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003392 00000100:00100000:2.0:1788619873.101380:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1788619873.101389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8155:x1875503657003392:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788619873.101709:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8155:x1875503657003392:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 320us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.101718:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1788619873.104728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619873.105014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003520 00000100:00100000:0.0:1788619873.105024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003520 00000100:00100000:0.0:1788619873.105084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1788619873.105094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8155:x1875503657003520:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788619873.105320:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8155:x1875503657003520:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 226us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619873.105338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1788619873.117021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.117202:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003648 00000100:00100000:1.0:1788619873.117212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003648 00000100:00100000:1.0:1788619873.117268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1788619873.117292:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8163:x1875503657003648:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788619873.117542:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8163:x1875503657003648:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 252us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.117550:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1788619873.122713:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619873.122879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003776 00000100:00100000:2.0:1788619873.122893:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003776 00000100:00100000:2.0:1788619873.122977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1788619873.122989:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8163:x1875503657003776:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788619873.123611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:8163:x1875503657003776:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 619us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.123621:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:3.0:1788619873.127952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619873.128000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619873.128093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004288 00000100:00100000:2.0:1788619873.128123:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004288 00000100:00100000:2.0:1788619873.128219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657003904 00000100:00100000:2.0:1788619873.128223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657003904 00000100:00100000:2.0:1788619873.128245:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788619873.128257:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657004288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619873.128350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657004288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.128358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788619873.128379:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788619873.128383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875503657003904:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788619873.128524:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b894fa53-facf-4302-9d74-955690a8c92e@192.168.203.12@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1788619873.128575:0:5842:0:(genops.c:1385:class_connect()) connect: client b894fa53-facf-4302-9d74-955690a8c92e, cookie 0xbb0e330328bbe162 00000004:00100000:2.0:1788619873.128618:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788619873.129012:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9333bd2c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788619873.129053:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+6:2353:x1875503657003904:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 668us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.129061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:1.0:1788619873.129430:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619873.133537:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619873.133586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619873.133688:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004032 00000100:00100000:3.0:1788619873.133700:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004032 00000100:00100000:3.0:1788619873.133839:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004160 00000100:00100000:3.0:1788619873.133844:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004160 00000100:00100000:3.0:1788619873.133868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788619873.133878:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+7:0:x1875503657004032:12345-192.168.203.12@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788619873.134124:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788619873.134135:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+7:8155:x1875503657004160:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788619873.134218:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788619873.134337:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+7:0:x1875503657004032:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 459us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.134345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000004:00000024:0.0:1788619873.134544:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788619873.134599:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:8155:x1875503657004160:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 468us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619873.134607:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:1.0:1788619873.134816:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619873.138724:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619873.139170:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004416 00000100:00100000:1.0:1788619873.139184:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004416 00000100:00100000:1.0:1788619873.139259:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788619873.139272:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+6:8155:x1875503657004416:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788619873.139535:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+6:8155:x1875503657004416:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 264us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.139543:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788619873.142579:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619873.142625:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619873.142695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619873.142871:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004544 00000100:00100000:2.0:1788619873.142890:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004544 00000100:00100000:2.0:1788619873.142957:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004672 00000100:00100000:2.0:1788619873.142961:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004672 00000100:00100000:2.0:1788619873.142994:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788619873.143011:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875503657004544:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788619873.143059:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b894fa53-facf-4302-9d74-955690a8c92e@192.168.203.12@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1788619873.143119:0:6692:0:(genops.c:1385:class_connect()) connect: client b894fa53-facf-4302-9d74-955690a8c92e, cookie 0xbb0e330328bbe169 00002000:00100000:2.0:1788619873.143139:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b894fa53-facf-4302-9d74-955690a8c92e/ffff9333bd2c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788619873.143186:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788619873.143655:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788619873.143703:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9333bd2c4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788619873.143844:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788619873.143857:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875503657004672:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788619873.143884:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b894fa53-facf-4302-9d74-955690a8c92e@192.168.203.12@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788619873.143916:0:6691:0:(genops.c:1385:class_connect()) connect: client b894fa53-facf-4302-9d74-955690a8c92e, cookie 0xbb0e330328bbe170 00002000:00100000:3.0:1788619873.143927:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b894fa53-facf-4302-9d74-955690a8c92e/ffff9333bcdeb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788619873.143958:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788619873.144481:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b894fa53-facf-4302-9d74-955690a8c92e+6:2353:x1875503657004544:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 1472us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.144490:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788619873.145016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004800 00000100:00100000:1.0:1788619873.145029:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004800 00000100:00100000:1.0:1788619873.145095:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788619873.145105:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:8155:x1875503657004800:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788619873.145206:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788619873.145279:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:8155:x1875503657004800:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 176us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.145286:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00080000:3.0:1788619873.150172:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788619873.150235:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9333bcdea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788619873.150333:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b894fa53-facf-4302-9d74-955690a8c92e+6:2353:x1875503657004672:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 6461us (7623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.150347:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788619873.479391:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676960640:0@lo:400:kworker.0 00000100:00100000:2.0:1788619873.479488:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619873.479578:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619873.479584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676960256:0@lo:400:kworker.0 00000100:00100000:2.0:1788619873.479617:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619873.479639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676960768:0@lo:400:kworker.0 00000100:00100000:2.0:1788619873.479663:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619873.479762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960768 00000100:00100000:0.0:1788619873.479809:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960768 00000100:00100000:0.0:1788619873.479875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619873.479886:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676960768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619873.479958:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676960768:12345-0@lo:400:kworker.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619873.479966:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619873.480012:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676960768:0@lo:400:kworker.0 00000100:00100000:0.0:1788619873.480038:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960256 00000100:00100000:0.0:1788619873.480042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960256 00000100:00100000:0.0:1788619873.480065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788619873.480071:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676960256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619873.480104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676960256:12345-0@lo:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619873.480110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788619873.480140:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676960256:0@lo:400:kworker.0 00000100:00080000:2.0:1788619873.480269:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619873.480341:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676960384:0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480374:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619873.480402:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676960896:0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619873.480450:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619873.480457:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676960512:0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480477:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619873.480507:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960384 00000100:00100000:3.0:1788619873.480511:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960384 00000100:00100000:3.0:1788619873.480548:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960512 00000100:00100000:3.0:1788619873.480551:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960512 00000100:00100000:3.0:1788619873.480569:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788619873.480575:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676960384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480610:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676960384:12345-0@lo:400:kworker.0 Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.480616:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788619873.480628:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788619873.480633:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676960512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480664:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676960512:12345-0@lo:400:kworker.0 Request processed in 31us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619873.480670:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788619873.480694:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676960512:0@lo:400:kworker.0 00000100:00100000:3.0:1788619873.480703:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676960384:0@lo:400:kworker.0 00000100:00080000:2.0:1788619873.480766:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619873.480860:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960640 00000100:00100000:0.0:1788619873.480864:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960640 00000100:00100000:0.0:1788619873.480904:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676960896 00000100:00100000:0.0:1788619873.480913:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676960896 00000100:00080000:2.0:1788619873.481015:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619873.481019:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619873.481054:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788619873.481063:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676960640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619873.481104:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676960640:12345-0@lo:400:kworker.0 Request processed in 44us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.481110:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788619873.481122:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788619873.481128:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676960896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619873.481152:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676960896:12345-0@lo:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619873.481168:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788619873.481204:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22df80 x1875503676960640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619873.481216:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676960640:0@lo:400:kworker.0 00010000:00080000:3.0:1788619873.481376:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22dc00 x1875503676960896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619873.481385:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676960896:0@lo:400:kworker.0 00010000:00010000:1.0:1788619873.735143:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619873.993007:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676961024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619873.993103:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619873.993261:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961024 00000100:00100000:0.0:1788619873.993273:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961024 00000100:00100000:1.0:1788619873.993353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788619873.993369:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676961024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619873.993415:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619873.993476:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676961024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619873.993484:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788619873.993542:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c0a80 x1875503676961024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619873.993563:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676961024:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788619874.053290:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00000100:00100000:0.0:1788619874.502933:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619874.502962:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676961152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619874.503686:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619874.504460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961152 00000100:00100000:1.0:1788619874.504473:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961152 00000100:00100000:1.0:1788619874.504546:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788619874.504557:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676961152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788619874.504591:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619874.506589:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676961152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2022us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619874.506606:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788619874.513353:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c2a00 x1875503676961152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619874.513393:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676961152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619874.759977:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788619875.050276:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00000001:00100000:3.0:1788619875.566332:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00010000:00010000:0.0:1788619875.785594:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619876.808438:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619877.831474:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619878.306217:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619878.306255:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619878.306287:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619878.306318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619878.306338:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619878.306362:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005440 00000100:00100000:0.0:1788619878.306370:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005440 00000100:00100000:0.0:1788619878.306422:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005312 00000100:00100000:0.0:1788619878.306424:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005312 00000100:00100000:0.0:1788619878.306446:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788619878.306457:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619878.306522:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619878.306529:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788619878.306545:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788619878.306552:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619878.306575:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619878.306591:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788619878.306610:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005184 00000100:00100000:0.0:1788619878.306614:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005184 00000100:00100000:0.0:1788619878.306652:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005056 00000100:00100000:0.0:1788619878.306666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005056 00000100:00100000:0.0:1788619878.306689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788619878.306696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619878.306723:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657005184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619878.306730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788619878.306741:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788619878.306748:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657005056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619878.306807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657005056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 60us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619878.306814:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00080000:0.0:1788619878.306834:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788619878.306838:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788619878.306840:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619878.307549:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657004928 00000100:00100000:3.0:1788619878.307556:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657004928 00000100:00100000:3.0:1788619878.307608:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1788619878.307615:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657004928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619878.307673:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657004928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 59us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619878.307679:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:0.0:1788619878.599004:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676961280:0@lo:400:kworker.0 00000100:00100000:0.0:1788619878.599075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619878.599208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961280 00000100:00100000:2.0:1788619878.599215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961280 00000100:00100000:2.0:1788619878.599260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788619878.599268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676961280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604245:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676961664:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619878.604373:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788619878.604379:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676961792:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604403:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619878.604432:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676961408:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604454:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619878.604472:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676961920:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604503:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619878.604521:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619878.604527:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676961536:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619878.604578:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961792 00000100:00100000:1.0:1788619878.604585:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961792 00000100:00100000:1.0:1788619878.604638:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961408 00000100:00100000:1.0:1788619878.604641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961408 00000100:00100000:1.0:1788619878.604653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961536 00000100:00100000:1.0:1788619878.604656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961536 00000100:00100000:1.0:1788619878.604671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788619878.604680:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676961792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604727:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676961792:12345-0@lo:400:kworker.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619878.604734:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788619878.604750:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788619878.604766:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676961408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676961408:12345-0@lo:400:kworker.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619878.604819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788619878.604829:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788619878.604834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676961536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.604855:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676961536:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619878.604860:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788619878.604877:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961664 00000100:00100000:1.0:1788619878.604880:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961664 00000100:00100000:1.0:1788619878.605057:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676961920 00000100:00100000:1.0:1788619878.605061:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676961920 00000100:00100000:1.0:1788619878.605084:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788619878.605089:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676961664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.605118:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676961664:12345-0@lo:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619878.605124:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788619878.605134:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788619878.605139:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676961920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.605162:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676961920:12345-0@lo:400:kworker.0 Request processed in 24us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619878.605167:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788619878.605319:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619878.605323:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619878.605326:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619878.605357:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676961792:0@lo:400:kworker.0 00010000:00080000:1.0:1788619878.605370:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22d500 x1875503676961664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619878.605380:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676961664:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.605406:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676961536:0@lo:400:kworker.0 00000100:00100000:1.0:1788619878.605415:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676961408:0@lo:400:kworker.0 00010000:00080000:1.0:1788619878.605423:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22ed80 x1875503676961920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619878.605431:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676961920:0@lo:400:kworker.0 00000100:00100000:2.0:1788619878.605711:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676961280:12345-0@lo:400:kworker.0 Request processed in 6442us (6634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619878.605720:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788619878.612032:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676961280:0@lo:400:kworker.0 00000001:02000400:3.0:1788619878.657649:0:10324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788619878.855953:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619879.111543:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619879.111569:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676962048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619879.111637:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619879.111718:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962048 00000100:00100000:2.0:1788619879.111725:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962048 00000100:00100000:2.0:1788619879.111805:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788619879.111816:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676962048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619879.111852:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619879.111901:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676962048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619879.111908:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788619879.111952:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c0e00 x1875503676962048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619879.111989:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676962048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619879.623106:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788619879.623130:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676962176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619879.623202:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619879.623352:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962176 00000100:00100000:2.0:1788619879.623360:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962176 00000100:00100000:2.0:1788619879.623411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788619879.623421:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676962176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619879.623469:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619879.623527:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676962176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619879.623535:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788619879.623852:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c3100 x1875503676962176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619879.623881:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676962176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619879.880290:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619880.903882:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619881.935479:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619882.952027:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619883.428520:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619883.428564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619883.428595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619883.428615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619883.428644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619883.428678:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005824 00000100:00100000:2.0:1788619883.428693:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005824 00000100:00100000:2.0:1788619883.428798:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005696 00000100:00100000:2.0:1788619883.428802:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005696 00000100:00100000:2.0:1788619883.428829:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788619883.428840:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657005824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619883.428948:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657005824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619883.428957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788619883.428980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788619883.428987:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657005696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619883.429037:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657005696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619883.429043:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788619883.429063:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006080 00000100:00100000:2.0:1788619883.429066:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006080 00000100:00100000:2.0:1788619883.429094:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005952 00000100:00100000:2.0:1788619883.429097:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005952 00000100:00100000:2.0:1788619883.429116:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788619883.429122:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657006080:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619883.429147:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657006080:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619883.429153:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788619883.429163:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788619883.429169:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657005952:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619883.429192:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657005952:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619883.429198:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00080000:2.0:1788619883.429223:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619883.429228:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619883.429230:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619883.429579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657005568 00000100:00100000:0.0:1788619883.429586:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657005568 00000100:00100000:0.0:1788619883.429627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1788619883.429634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657005568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619883.429672:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657005568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619883.429679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1788619883.719155:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676962432:0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619883.719308:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676962944:0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719337:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619883.719371:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619883.719377:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676962560:0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719399:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619883.719435:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962432 00000100:00100000:1.0:1788619883.719444:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962432 00000100:00100000:1.0:1788619883.719507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962560 00000100:00100000:1.0:1788619883.719510:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962560 00000100:00100000:1.0:1788619883.719546:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788619883.719556:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676962432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719627:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676962432:12345-0@lo:400:kworker.0 Request processed in 72us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619883.719635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788619883.719653:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788619883.719660:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676962560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719686:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676962560:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619883.719692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788619883.719709:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962944 00000100:00100000:1.0:1788619883.719713:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962944 00000100:00100000:1.0:1788619883.719763:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788619883.719788:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719818:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676962944:12345-0@lo:400:kworker.0 Request processed in 49us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619883.719836:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788619883.719862:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619883.719868:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619883.719907:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676962560:0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.719917:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676962432:0@lo:400:kworker.0 00010000:00080000:1.0:1788619883.719930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22f800 x1875503676962944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619883.719941:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676962944:0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720029:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676962688:0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720062:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619883.720091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788619883.720097:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676962304:0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720122:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619883.720146:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676962816:0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720168:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619883.720192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962304 00000100:00100000:0.0:1788619883.720196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962304 00000100:00100000:0.0:1788619883.720225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788619883.720232:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676962304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720265:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676962304:12345-0@lo:400:kworker.0 Request processed in 34us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619883.720272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788619883.720311:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676962304:0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720326:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962816 00000100:00100000:0.0:1788619883.720328:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962816 00000100:00100000:0.0:1788619883.720355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788619883.720361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676962816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619883.720399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676962816:12345-0@lo:400:kworker.0 Request processed in 39us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619883.720406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788619883.720422:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619883.720437:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676962816:0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.720850:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676962688 00000100:00100000:1.0:1788619883.720855:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676962688 00000100:00100000:1.0:1788619883.720938:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788619883.720945:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676962688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619883.720990:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676962688:12345-0@lo:400:kworker.0 Request processed in 45us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619883.720996:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788619883.721037:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22d500 x1875503676962688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619883.721049:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676962688:0@lo:400:kworker.0 00000100:00080000:0.0:1788619883.727553:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788619883.975020:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619884.232056:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676963072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619884.233366:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619884.236115:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963072 00000100:00100000:2.0:1788619884.237322:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963072 00000100:00100000:2.0:1788619884.237403:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788619884.237415:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676963072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619884.237471:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619884.237577:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676963072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (4216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619884.237586:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788619884.265974:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338703b480 x1875503676963072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619884.266011:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676963072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619884.743894:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619884.743921:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676963200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619884.743983:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619884.744036:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963200 00000100:00100000:0.0:1788619884.744042:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963200 00000100:00100000:0.0:1788619884.744322:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788619884.744332:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676963200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619884.744376:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619884.744475:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676963200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619884.744482:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788619884.744521:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c2300 x1875503676963200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619884.744537:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676963200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619885.004129:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619886.023108:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619887.051584:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619888.071330:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619888.543485:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619888.543532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619888.543569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619888.543601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006720 00000100:00100000:2.0:1788619888.543610:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006720 00000100:00100000:3.0:1788619888.543618:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006208 00000100:00100000:3.0:1788619888.543625:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006208 00000100:00100000:3.0:1788619888.543682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1788619888.543695:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788619888.543704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657006208:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619888.543710:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619888.543809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006464 00000100:00100000:1.0:1788619888.543814:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006464 00000100:00100000:1.0:1788619888.543848:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788619888.543856:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619888.543952:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 247us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.543959:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00080000:2.0:1788619888.543979:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788619888.543983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619888.558191:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657006208:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 14478us (14703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619888.558207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:0.0:1788619888.558340:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619888.558383:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619888.558427:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006592 00000100:00100000:0.0:1788619888.558435:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006592 00000100:00100000:0.0:1788619888.558501:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788619888.558522:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619888.558563:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006336 00000100:00100000:3.0:1788619888.558569:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006336 00000100:00100000:0.0:1788619888.558571:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619888.558580:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788619888.558605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788619888.558613:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657006336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788619888.558628:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788619888.558634:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619888.558645:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657006336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619888.558658:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788619888.566870:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657006464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23002us (23324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619888.566887:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788619888.839058:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676963712:0@lo:400:kworker.0 00000100:00100000:1.0:1788619888.839126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619888.839171:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788619888.839176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676963328:0@lo:400:kworker.0 00000100:00100000:1.0:1788619888.839199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619888.839230:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676963840:0@lo:400:kworker.0 00000100:00100000:1.0:1788619888.839252:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619888.839279:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963328 00000100:00100000:1.0:1788619888.839285:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963328 00000100:00100000:1.0:1788619888.839505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788619888.839514:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676963328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619888.839557:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676963328:12345-0@lo:400:kworker.0 Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619888.839564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788619888.839606:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676963328:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839663:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676963456:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839700:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619888.839724:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676963968:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839742:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619888.839757:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619888.839762:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676963584:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619888.839853:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963712 00000100:00100000:2.0:1788619888.839857:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963712 00000100:00100000:2.0:1788619888.839888:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963968 00000100:00100000:2.0:1788619888.839890:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963968 00000100:00100000:2.0:1788619888.839908:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788619888.839914:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676963712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839945:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676963712:12345-0@lo:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.839951:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788619888.839961:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788619888.839967:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676963968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.839990:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676963968:12345-0@lo:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.839996:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788619888.840021:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963840 00000100:00100000:2.0:1788619888.840024:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963840 00000100:00100000:2.0:1788619888.840042:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963456 00000100:00100000:2.0:1788619888.840044:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963456 00000100:00100000:2.0:1788619888.840052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676963584 00000100:00100000:2.0:1788619888.840054:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676963584 00000100:00100000:2.0:1788619888.840065:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788619888.840071:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676963840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.840094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676963840:12345-0@lo:400:kworker.0 Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.840100:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788619888.840109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788619888.840114:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676963456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.840141:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676963456:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.840146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788619888.840156:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788619888.840161:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676963584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.840179:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676963584:12345-0@lo:400:kworker.0 Request processed in 19us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619888.840184:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788619888.840196:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788619888.840199:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619888.840202:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619888.840234:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676963840:0@lo:400:kworker.0 00010000:00080000:2.0:1788619888.840247:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22ca80 x1875503676963712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619888.840258:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676963712:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.840278:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676963584:0@lo:400:kworker.0 00000100:00100000:2.0:1788619888.840287:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676963456:0@lo:400:kworker.0 00010000:00080000:2.0:1788619888.840294:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22e300 x1875503676963968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619888.840588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676963968:0@lo:400:kworker.0 00010000:00010000:1.0:1788619889.099740:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619889.352807:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619889.352836:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676964096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619889.352929:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619889.353006:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964096 00000100:00100000:0.0:1788619889.353015:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964096 00000100:00100000:0.0:1788619889.353073:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788619889.353084:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676964096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619889.353128:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619889.353182:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676964096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619889.353191:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788619889.353253:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c1c00 x1875503676964096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619889.355341:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676964096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619889.862952:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619889.862975:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676964224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619889.863043:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619889.863101:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964224 00000100:00100000:0.0:1788619889.863108:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964224 00000100:00100000:0.0:1788619889.863152:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788619889.863175:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676964224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619889.863226:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619889.863271:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676964224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619889.863277:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788619889.863328:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c1c00 x1875503676964224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619889.863347:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676964224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619890.119807:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619891.142952:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619892.167583:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619893.192441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619893.668840:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619893.668895:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619893.668930:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007104 00000100:00100000:2.0:1788619893.668944:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007104 00000100:00100000:2.0:1788619893.669001:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1788619893.669012:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657007104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619893.669076:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657007104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.669083:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00080000:2.0:1788619893.669105:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619893.669220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006848 00000100:00100000:0.0:1788619893.669225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006848 00000100:00100000:0.0:1788619893.669261:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:0.0:1788619893.669269:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2357:x1875503657006848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619893.669296:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2357:x1875503657006848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619893.669302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:2.0:1788619893.676883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619893.676920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619893.676948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619893.676978:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007232 00000100:00100000:2.0:1788619893.676988:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007232 00000100:00100000:2.0:1788619893.677039:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007360 00000100:00100000:2.0:1788619893.677042:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007360 00000100:00100000:2.0:1788619893.677064:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788619893.677074:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2353:x1875503657007232:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1788619893.677106:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe169 00000100:00080000:2.0:1788619893.677116:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9333bd2c4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788619893.677151:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788619893.677482:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+2:2353:x1875503657007232:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 408us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.677490:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788619893.677506:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788619893.677514:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2353:x1875503657007360:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1788619893.677527:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe170 00000100:00080000:2.0:1788619893.677532:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9333bcdea800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788619893.677551:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788619893.677799:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b894fa53-facf-4302-9d74-955690a8c92e+2:2353:x1875503657007360:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 285us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.677806:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00080000:2.0:1788619893.677827:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619893.677830:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788619893.677989:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619893.678070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657006976 00000100:00100000:3.0:1788619893.678076:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657006976 00000100:00100000:3.0:1788619893.678131:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1788619893.678139:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657006976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619893.678181:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657006976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619893.678189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1788619893.678208:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788619893.678412:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619893.959058:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676964352:0@lo:400:kworker.0 00000100:00100000:3.0:1788619893.959121:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619893.959216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964352 00000100:00100000:1.0:1788619893.959224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964352 00000100:00100000:1.0:1788619893.959269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788619893.959278:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676964352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619893.959409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676964352:12345-0@lo:400:kworker.0 Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619893.959417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788619893.964953:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676964736:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965016:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619893.965050:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619893.965056:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676964864:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965076:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619893.965098:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676964480:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965117:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619893.965133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676964992:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619893.965163:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619893.965167:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676964608:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965183:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619893.965211:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964736 00000100:00100000:2.0:1788619893.965217:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964736 00000100:00100000:2.0:1788619893.965258:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964992 00000100:00100000:2.0:1788619893.965260:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964992 00000100:00100000:2.0:1788619893.965278:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788619893.965285:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676964736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965329:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676964736:12345-0@lo:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.965335:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788619893.965356:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788619893.965362:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676964992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965390:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676964992:12345-0@lo:400:kworker.0 Request processed in 29us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.965395:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788619893.965410:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964864 00000100:00100000:2.0:1788619893.965413:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964864 00000100:00100000:2.0:1788619893.965435:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964480 00000100:00100000:2.0:1788619893.965437:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964480 00000100:00100000:2.0:1788619893.965446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676964608 00000100:00100000:2.0:1788619893.965448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676964608 00000100:00100000:2.0:1788619893.965459:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788619893.965464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676964864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965488:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676964864:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.965494:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788619893.965504:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788619893.965508:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676964480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965534:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676964480:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.965539:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788619893.965549:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788619893.965555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676964608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676964608:12345-0@lo:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619893.965585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788619893.965608:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788619893.965617:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619893.965618:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619893.965666:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676964608:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965676:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676964480:0@lo:400:kworker.0 00010000:00080000:2.0:1788619893.965686:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333c1ee2d80 x1875503676964992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619893.965696:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676964992:0@lo:400:kworker.0 00000100:00100000:2.0:1788619893.965722:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676964864:0@lo:400:kworker.0 00010000:00080000:2.0:1788619893.965730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333c1ee1500 x1875503676964736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619893.965739:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676964736:0@lo:400:kworker.0 00000100:00100000:3.0:1788619893.965958:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676964352:0@lo:400:kworker.0 00010000:00010000:1.0:1788619894.215391:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619894.473515:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619894.473537:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676965120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619894.473598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619894.473674:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965120 00000100:00100000:0.0:1788619894.473681:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965120 00000100:00100000:0.0:1788619894.473723:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788619894.473732:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676965120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619894.473764:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619894.473832:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676965120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619894.473847:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788619894.473959:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c1c00 x1875503676965120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619894.473976:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676965120:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788619894.506519:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00000020:00000080:3.0:1788619894.506528:0:7647:0:(genops.c:885:class_export_put()) final put ffff9333bcdeb000/b894fa53-facf-4302-9d74-955690a8c92e 00000020:00000080:3.0:1788619894.506554:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bcdeb000/b894fa53-facf-4302-9d74-955690a8c92e for lustre-OST0001 00000020:00000080:3.0:1788619894.506594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bcdea800 for lustre-OST0001 00000100:00100000:3.0:1788619894.987297:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676965248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619894.987362:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619894.990087:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965248 00000100:00100000:1.0:1788619894.990101:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965248 00000100:00100000:1.0:1788619894.990163:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788619894.990360:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676965248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788619894.990405:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619894.990529:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676965248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 357us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619894.990536:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788619894.996336:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333c1ee1500 x1875503676965248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619894.996364:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676965248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619895.240543:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788619896.102093:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00000020:00000080:2.0:1788619896.102103:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333bd2c7000/b894fa53-facf-4302-9d74-955690a8c92e 00000020:00000080:2.0:1788619896.102138:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd2c7000/b894fa53-facf-4302-9d74-955690a8c92e for lustre-OST0000 00000020:00000080:2.0:1788619896.102190:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bd2c4000 for lustre-OST0000 00010000:00010000:0.0:1788619896.263113:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619897.286925:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619898.311016:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619898.798206:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619898.798262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619898.798405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619898.798441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007744 00000100:00100000:1.0:1788619898.798453:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007744 00000100:00100000:1.0:1788619898.798528:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007616 00000100:00100000:1.0:1788619898.798532:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007616 00000100:00100000:1.0:1788619898.798558:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788619898.798569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657007744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619898.798679:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657007744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 111us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619898.798687:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788619898.798708:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1788619898.798733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657007616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619898.798763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657007616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619898.798798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00080000:1.0:1788619898.798821:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619898.806932:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007488 00000100:00100000:0.0:1788619898.806956:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007488 00000100:00100000:0.0:1788619898.807061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:0.0:1788619898.807074:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657007488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619898.807187:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657007488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 115us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619898.807206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1788619899.080102:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676965376:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080224:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676965888:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080251:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080283:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619899.080290:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676965760:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080318:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080351:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676965504:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080398:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080434:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676966016:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080476:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619899.080518:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676965632:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080544:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619899.080585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965376 00000100:00100000:2.0:1788619899.080594:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965376 00000100:00100000:2.0:1788619899.080653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788619899.080663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676965376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080715:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676965376:12345-0@lo:400:kworker.0 Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.080722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788619899.080753:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965888 00000100:00100000:2.0:1788619899.080757:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965888 00000100:00100000:2.0:1788619899.080828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965504 00000100:00100000:2.0:1788619899.080832:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965504 00000100:00100000:2.0:1788619899.080845:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965632 00000100:00100000:2.0:1788619899.080847:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965632 00000100:00100000:2.0:1788619899.080861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788619899.080867:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676965888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080910:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676965888:12345-0@lo:400:kworker.0 Request processed in 43us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.080917:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788619899.080931:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788619899.080936:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676965504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.080974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676965504:12345-0@lo:400:kworker.0 Request processed in 38us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.080986:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788619899.080998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788619899.081003:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676965632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.081029:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676965632:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.081035:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788619899.081053:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676965760 00000100:00100000:2.0:1788619899.081057:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676965760 00000100:00100000:2.0:1788619899.081082:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966016 00000100:00100000:2.0:1788619899.081085:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966016 00000100:00100000:2.0:1788619899.081104:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788619899.081111:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676965760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.081140:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676965760:12345-0@lo:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.081145:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788619899.081156:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788619899.081161:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676966016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.081186:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676966016:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619899.081191:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788619899.081237:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619899.081248:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788619899.081251:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788619899.081324:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333c1ee0a80 x1875503676965760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619899.081342:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676965760:0@lo:400:kworker.0 00000100:00100000:0.0:1788619899.081356:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676965376:0@lo:400:kworker.0 00000100:00100000:0.0:1788619899.081370:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676965888:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.082751:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676965632:0@lo:400:kworker.0 00000100:00100000:2.0:1788619899.082785:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676965504:0@lo:400:kworker.0 00010000:00080000:2.0:1788619899.082801:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333c1ee1180 x1875503676966016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619899.082811:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676966016:0@lo:400:kworker.0 00010000:00010000:1.0:1788619899.334993:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619899.595543:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676966144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619899.595679:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619899.595890:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966144 00000100:00100000:1.0:1788619899.595903:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966144 00000100:00100000:1.0:1788619899.595973:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788619899.595984:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676966144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619899.596032:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619899.596093:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676966144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619899.596100:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788619899.596148:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c1c00 x1875503676966144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619899.596173:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676966144:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788619899.927833:0:11028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788619900.104018:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676966272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619900.104126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619900.104400:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966272 00000100:00100000:2.0:1788619900.104412:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966272 00000100:00100000:2.0:1788619900.104477:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788619900.104488:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676966272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619900.104534:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619900.104597:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676966272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619900.104615:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788619900.104692:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bcbe7100 x1875503676966272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619900.104713:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676966272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619900.361260:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619901.382941:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619902.407239:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619903.433271:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788619903.777045:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb36dca0 20000000:00000080:2.0:1788619903.777061:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933285529400 uarg=0000000000000000 20000000:01000000:2.0:1788619903.777094:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788619903.777100:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788619903.777104:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788619903.778332:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788619903.778493:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788619903.793954:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788619903.794715:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.794737:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.794993:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.794999:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795004:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795021:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795027:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795064:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795078:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 12 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.795090:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966400:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619903.795184:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795192:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.795200:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966528:0@lo:104: 00000100:00100000:2.0:1788619903.795235:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619903.795267:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795274:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.795281:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966656:0@lo:104: 00000100:00100000:2.0:1788619903.795309:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619903.795337:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795346:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.795354:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966784:0@lo:104: 00000100:00100000:2.0:1788619903.795508:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788619903.795530:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.795538:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.795546:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966912:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619903.795574:0:11176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619903.795632:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966528 00000100:00100000:1.0:1788619903.795640:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966528 00000100:00100000:1.0:1788619903.795673:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966656 00000100:00100000:1.0:1788619903.795676:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966656 00000100:00100000:1.0:1788619903.795686:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676966784 00000100:00100000:1.0:1788619903.795695:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676966784 00000100:00100000:1.0:1788619903.795713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619903.795722:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:11176:x1875503676966528:12345-0@lo:104: 00010000:00010000:1.0:1788619903.795734:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.795860:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619903.795866:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+5:11176:x1875503676966528:12345-0@lo:104: Request processed in 146us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619903.795873:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788619903.795890:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788619903.795896:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:11176:x1875503676966656:12345-0@lo:104: 00010000:00010000:1.0:1788619903.795902:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.795934:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788619903.795939:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+4:11176:x1875503676966656:12345-0@lo:104: Request processed in 44us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619903.795944:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788619903.795955:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788619903.795960:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:11176:x1875503676966784:12345-0@lo:104: 00010000:00010000:1.0:1788619903.795967:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.795998:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788619903.796003:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42040134-1c22-4778-8507-c9e1e3983208+3:11176:x1875503676966784:12345-0@lo:104: Request processed in 43us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619903.796008:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788619903.796054:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788619903.796059:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.796066:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380031000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619903.796070:0:7635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.796078:0:7635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619903.796085:0:7635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619903.796090:0:7635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788619903.796092:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966528:0@lo:104: 00000100:00100000:2.0:1788619903.796099:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966656:0@lo:104: 00000100:00100000:2.0:1788619903.796105:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966784:0@lo:104: 00010000:00010000:2.0:1788619903.796124:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788619903.796129:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796135:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fa00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788619903.796138:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796144:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788619903.796157:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619903.796163:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788619903.796179:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796185:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619903.796203:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796211:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18fa00/0xbb0e330328bbe131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe138 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796223:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619903.796226:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796232:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788619903.796235:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796240:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788619903.796247:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619903.796252:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788619903.796271:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796277:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619903.796290:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796296:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31600/0xbb0e330328bbe123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe12a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796305:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619903.796306:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619903.796308:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619903.796318:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676967168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788619903.796348:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619903.796386:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619903.796394:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676967040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788619903.796418:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619903.796442:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967168 00000100:00100000:2.0:1788619903.796446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967168 00010000:00010000:2.0:1788619903.796466:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 19 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.796485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967040 00000100:00100000:2.0:1788619903.796488:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967040 00010000:00010000:2.0:1788619903.796499:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.796516:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788619903.796523:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387306c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+20:3311:x1875503676967168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788619903.796541:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619903.796546:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796554:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796566:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031400/0xbb0e330328bbe12a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe123 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.796576:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619903.796605:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619903.796614:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387306c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676967168:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619903.796620:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788619903.796643:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788619903.796651:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42040134-1c22-4778-8507-c9e1e3983208+18:3309:x1875503676967040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788619903.796664:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788619903.796668:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676967168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788619903.796669:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619903.796676:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619903.796686:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030000/0xbb0e330328bbe138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe131 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619903.796695:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619903.796724:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42040134-1c22-4778-8507-c9e1e3983208+17:3309:x1875503676967040:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619903.796730:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788619903.796732:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676967040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619903.797116:0:7635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797124:0:7635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619903.797146:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797154:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe13f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe146 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797168:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619903.797170:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619903.797172:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619903.797177:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619903.797186:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676967296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619903.797213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619903.797245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967296 00000100:00100000:1.0:1788619903.797249:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967296 00010000:00010000:1.0:1788619903.797263:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619903.797374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788619903.797381:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+17:3311:x1875503676967296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619903.797389:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619903.797394:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 17 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797402:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 17 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797413:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031c00/0xbb0e330328bbe146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe13f expref: 17 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619903.797421:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619903.797455:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+16:3311:x1875503676967296:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619903.797461:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788619903.797652:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676967296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619903.802124:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966400:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619903.802138:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875503676966912:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619903.802188:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619903.803464:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619903.803565:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657007872 00000100:00100000:2.0:1788619903.803573:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657007872 00010000:00010000:2.0:1788619903.803617:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 13 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619903.803766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619903.804039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008000 00000100:00100000:2.0:1788619903.804044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008000 00010000:00010000:2.0:1788619903.804060:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 14 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619903.804090:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788619903.804099:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+14:2355:x1875503657007872:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619903.804128:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619903.804135:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 14 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804147:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 14 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804174:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18f000/0xbb0e330328bbe15b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a844 expref: 14 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804188:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619903.804235:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657007872:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 137us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619903.804243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788619903.804261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788619903.804267:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:2355:x1875503657008000:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619903.804275:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619903.804280:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804289:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804299:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe11c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a80c expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804310:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804329:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804343:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804350:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804357:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804364:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804372:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619903.804376:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804384:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804399:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619903.804409:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619903.804430:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2355:x1875503657008000:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 163us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619903.804436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:3.0:1788619903.805002:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619903.805012:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619903.805018:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eb600/0xbb0e330328bbe177 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619903.902799:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619903.902848:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619903.902880:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008128 00000100:00100000:3.0:1788619903.902889:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008128 00000100:00100000:3.0:1788619903.902942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008256 00000100:00100000:3.0:1788619903.902945:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008256 00000100:00100000:3.0:1788619903.902973:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1788619903.902994:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657008128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619903.903064:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657008128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619903.903079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1788619903.903096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1788619903.903103:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657008256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619903.903145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657008256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619903.903151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00080000:3.0:1788619903.903167:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619904.202192:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676967808:0@lo:400:kworker.0 00000100:00100000:3.0:1788619904.202260:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619904.202326:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788619904.202333:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676967680:0@lo:400:kworker.0 00000100:00100000:3.0:1788619904.202358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619904.202388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967680 00000100:00100000:3.0:1788619904.202395:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967680 00000100:00100000:3.0:1788619904.202444:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788619904.202455:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619904.202514:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676967680:12345-0@lo:400:kworker.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619904.202522:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788619904.202540:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619904.202570:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676967680:0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.202876:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676967424:0@lo:400:kworker.0 00000100:00100000:1.0:1788619904.202894:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967808 00000100:00100000:1.0:1788619904.202898:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967808 00000100:00100000:2.0:1788619904.202923:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619904.202939:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788619904.202947:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676967808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.202960:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676967936:0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.202979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619904.202996:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788619904.202999:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676967808:12345-0@lo:400:kworker.0 Request processed in 54us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619904.203002:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676967552:0@lo:400:kworker.0 00000100:00100000:1.0:1788619904.203005:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788619904.203020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619904.203038:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676968064:0@lo:400:kworker.0 00010000:00080000:1.0:1788619904.203039:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc454a80 x1875503676967808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619904.203049:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676967808:0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.203057:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619904.203075:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967936 00000100:00100000:2.0:1788619904.203077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968064 00000100:00100000:2.0:1788619904.203079:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968064 00000100:00100000:1.0:1788619904.203079:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967936 00000100:00100000:1.0:1788619904.203101:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967552 00000100:00100000:2.0:1788619904.203103:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788619904.203104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967552 00000100:00100000:2.0:1788619904.203108:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676968064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619904.203119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788619904.203124:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676967936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.203142:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676968064:12345-0@lo:400:kworker.0 Request processed in 33us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619904.203149:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788619904.203150:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676967936:12345-0@lo:400:kworker.0 Request processed in 25us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619904.203155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788619904.203164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788619904.203169:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676967552:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788619904.203174:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc045500 x1875503676968064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619904.203184:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676968064:0@lo:400:kworker.0 00000100:00100000:2.0:1788619904.203193:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676967936:0@lo:400:kworker.0 00000100:00100000:1.0:1788619904.203193:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676967552:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619904.203198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788619904.203210:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676967552:0@lo:400:kworker.0 00000100:00100000:1.0:1788619904.203213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676967424 00000100:00100000:1.0:1788619904.203216:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676967424 00000100:00100000:1.0:1788619904.203243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788619904.203250:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676967424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788619904.203322:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788619904.203325:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788619904.203327:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788619904.208369:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676967424:12345-0@lo:400:kworker.0 Request processed in 5110us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619904.208384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788619904.211913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676967424:0@lo:400:kworker.0 00010000:00010000:1.0:1788619904.457173:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619904.713707:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788619904.713724:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676968192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619904.713806:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619904.713983:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968192 00000100:00100000:2.0:1788619904.713990:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968192 00000100:00100000:2.0:1788619904.714042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788619904.714061:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676968192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619904.714093:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619904.714150:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676968192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619904.714157:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788619904.714216:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c3b80 x1875503676968192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619904.714235:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676968192:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788619904.967079:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788619904.967088:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333861ca800 from 7 10000000:01000000:0.0:1788619904.967093:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788619904.967137:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.967150:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.967174:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619904.967213:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788619904.967274:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619904.967330:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181180 going to sleep for 11 seconds 00000100:00100000:3.0:1788619904.969011:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968320 00000100:00100000:3.0:1788619904.969032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968320 00000100:00100000:3.0:1788619904.969109:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788619904.969120:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676968320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619904.969135:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619904.969153:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe17e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.969181:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.969192:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.969202:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:3.0:1788619904.969261:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619904.969268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788619904.971293:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619904.971322:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.971335:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619904.971415:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619904.971465:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619904.971510:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181180 going to sleep for 11 seconds 00000100:00100000:2.0:1788619904.972109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968448 00000100:00100000:2.0:1788619904.972116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968448 00000100:00100000:2.0:1788619904.972237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788619904.972247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619904.972543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619904.972552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788619904.972762:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619904.972823:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619904.972866:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619904.972894:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181180 going to sleep for 11 seconds 00000100:00100000:0.0:1788619904.972909:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968576 00000100:00100000:0.0:1788619904.972923:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968576 00000100:00100000:0.0:1788619904.972952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788619904.972960:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619904.973115:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619904.973122:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788619904.973301:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788619904.975144:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788619904.975429:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788619904.975451:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788619904.975461:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.975474:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619904.975485:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788619904.975487:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bbf76000 from 7 10000000:01000000:3.0:1788619904.975491:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788619904.975536:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.975559:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.975578:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619904.975602:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788619904.975659:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619904.975698:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788619904.980328:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968704 00000100:00100000:0.0:1788619904.980343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968704 00000100:00100000:0.0:1788619904.980404:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788619904.980414:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676968704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619904.980430:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619904.980448:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe18c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.980474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.980486:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.980495:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031400, rc 0) 00000100:00100000:0.0:1788619904.980581:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676968704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (4913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619904.980588:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788619904.983857:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619904.983883:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619904.983896:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619904.983989:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619904.984050:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619904.984088:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788619904.984561:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968832 00000100:00100000:0.0:1788619904.984568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968832 00000100:00100000:0.0:1788619904.984631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788619904.984642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676968832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619904.984991:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676968832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619904.985010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788619904.985041:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619904.985077:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619904.985120:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619904.985161:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788619904.985270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676968960 00000100:00100000:2.0:1788619904.985275:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676968960 00000100:00100000:2.0:1788619904.985311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788619904.985317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676968960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619904.985469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676968960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619904.985476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788619904.985591:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676968960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788619904.987337:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788619904.994426:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788619904.994462:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788619904.994474:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619904.994505:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619904.994610:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788619904.994614:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93338a7b5000 from 7 10000000:01000000:2.0:1788619904.994617:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788619904.994655:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619904.994668:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619904.994679:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619904.994702:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788619904.994794:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619904.994831:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619904.999692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969088 00000100:00100000:1.0:1788619904.999705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969088 00000100:00100000:1.0:1788619904.999798:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788619904.999807:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676969088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619904.999824:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619904.999841:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe19a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619904.999866:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619904.999877:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619904.999884:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18f400, rc 0) 00000100:00100000:1.0:1788619904.999967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676969088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619904.999973:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788619905.000024:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619905.000043:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619905.000053:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619905.000117:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788619905.000169:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619905.000196:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788619905.006255:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969216 00000100:00100000:0.0:1788619905.006269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969216 00000100:00100000:0.0:1788619905.006326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788619905.006337:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676969216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619905.006753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676969216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (6582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619905.006761:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788619905.007669:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619905.007725:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619905.007803:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619905.007881:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788619905.011135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969344 00000100:00100000:1.0:1788619905.011159:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969344 00000100:00100000:1.0:1788619905.011218:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788619905.011228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676969344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619905.011464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676969344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619905.011472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788619905.011667:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676969344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788619905.013023:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788619905.013285:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788619905.013307:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788619905.013318:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619905.013330:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619905.222986:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676969472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619905.223060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619905.223119:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969472 00000100:00100000:2.0:1788619905.223126:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969472 00000100:00100000:2.0:1788619905.223183:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788619905.223194:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676969472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619905.223227:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619905.223271:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676969472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619905.223278:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788619905.223316:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc046300 x1875503676969472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619905.223512:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676969472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619905.377210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619905.377338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008384 00000100:00100000:1.0:1788619905.377348:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008384 00000100:00100000:1.0:1788619905.377409:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:1.0:1788619905.377420:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:5598:x1875503657008384:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619905.377435:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619905.377454:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a86e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619905.377485:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619905.377496:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619905.377505:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18ec00, rc 0) 00000100:00100000:1.0:1788619905.377564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008384:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 146us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619905.377587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1788619905.383375:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619905.383468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008512 00000100:00100000:0.0:1788619905.383478:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008512 00000100:00100000:0.0:1788619905.383533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:0.0:1788619905.383544:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008512:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619905.386397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008512:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 2844us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619905.386411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:1.0:1788619905.397651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619905.399913:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008640 00000100:00100000:0.0:1788619905.399927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008640 00000100:00100000:0.0:1788619905.399985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:0.0:1788619905.399999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008640:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619905.400306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008640:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 308us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619905.400316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:0.0:1788619905.420560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619905.420615:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008768 00000100:00100000:0.0:1788619905.420626:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008768 00000100:00100000:0.0:1788619905.420694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:0.0:1788619905.420705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657008768:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619905.420722:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619905.421169:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a875 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619905.421203:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619905.421214:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619905.421224:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031800, rc 0) 00000100:00100000:0.0:1788619905.421281:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657008768:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 579us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619905.421290:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:2.0:1788619905.430153:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619905.433414:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657008896 00000100:00100000:0.0:1788619905.433427:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657008896 00000100:00100000:0.0:1788619905.433485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1788619905.433495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657008896:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619905.436248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657008896:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 326us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619905.436267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1788619905.439245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619905.439878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009024 00000100:00100000:1.0:1788619905.439889:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009024 00000100:00100000:1.0:1788619905.439944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:1.0:1788619905.440111:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657009024:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619905.440347:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657009024:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 239us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619905.450344:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00010000:00010000:0.0:1788619905.479074:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619906.503029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619907.527474:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788619908.226836:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788619908.552394:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619909.020583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619909.020650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619909.020686:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619909.020809:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009152 00000100:00100000:1.0:1788619909.020822:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009152 00000100:00100000:1.0:1788619909.020889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:1.0:1788619909.020900:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657009152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619909.020986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657009152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619909.020994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:2.0:1788619909.021405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009408 00000100:00100000:2.0:1788619909.021420:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009408 00000100:00100000:3.0:1788619909.021469:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009280 00000100:00100000:3.0:1788619909.021478:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009280 00000100:00100000:2.0:1788619909.021557:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788619909.021572:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657009408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619909.021655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657009408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.021663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788619909.021682:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788619909.021690:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657009280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619909.021717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657009280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.021722:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00080000:0.0:1788619909.021806:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619909.319061:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676969984:0@lo:400:kworker.0 00000100:00100000:3.0:1788619909.319131:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619909.319194:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788619909.319200:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676969856:0@lo:400:kworker.0 00000100:00100000:3.0:1788619909.319227:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619909.319261:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969856 00000100:00100000:3.0:1788619909.319269:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969856 00000100:00100000:3.0:1788619909.319328:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788619909.319338:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676969856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619909.319473:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676969856:12345-0@lo:400:kworker.0 Request processed in 136us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619909.319481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788619909.319501:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619909.319534:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676969856:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319635:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676969600:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619909.319705:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676970112:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619909.319757:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619909.319763:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676969728:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619909.319827:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676970240:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319865:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619909.319891:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969984 00000100:00100000:2.0:1788619909.319894:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969984 00000100:00100000:2.0:1788619909.319926:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970240 00000100:00100000:2.0:1788619909.319929:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970240 00000100:00100000:2.0:1788619909.319951:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788619909.319958:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676969984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.319997:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676969984:12345-0@lo:400:kworker.0 Request processed in 39us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.320002:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788619909.320015:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788619909.320021:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676970240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.320053:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676970240:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.320059:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788619909.320079:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619909.320081:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788619909.320098:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc454e00 x1875503676970240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619909.320110:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676970240:0@lo:400:kworker.0 00010000:00080000:2.0:1788619909.320132:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc046300 x1875503676969984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619909.320141:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676969984:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.320155:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970112 00000100:00100000:2.0:1788619909.320157:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970112 00000100:00100000:2.0:1788619909.320183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969728 00000100:00100000:2.0:1788619909.320193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969728 00000100:00100000:2.0:1788619909.320216:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788619909.320222:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.320273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676970112:12345-0@lo:400:kworker.0 Request processed in 50us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.320279:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788619909.320294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788619909.320299:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.320324:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676969728:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619909.320330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788619909.320345:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619909.320362:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676969728:0@lo:400:kworker.0 00000100:00100000:2.0:1788619909.320371:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676970112:0@lo:400:kworker.0 00000100:00100000:3.0:1788619909.320804:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676969600 00000100:00100000:3.0:1788619909.320815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676969600 00000100:00100000:3.0:1788619909.320851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788619909.320858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676969600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619909.320900:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676969600:12345-0@lo:400:kworker.0 Request processed in 43us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619909.320906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788619909.321064:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676969600:0@lo:400:kworker.0 00010000:00010000:0.0:1788619909.577106:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619909.831267:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788619909.831288:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333861c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619909.831364:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619909.831585:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970368 00000100:00100000:0.0:1788619909.831594:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970368 00000100:00100000:0.0:1788619909.831662:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788619909.831671:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676970368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619909.831705:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619909.831748:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676970368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619909.831756:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788619909.833095:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333861c0a80 x1875503676970368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619909.833187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333861c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619910.347822:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619910.347852:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676970496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619910.347943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619910.348020:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970496 00000100:00100000:3.0:1788619910.348030:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970496 00000100:00100000:3.0:1788619910.348086:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788619910.348095:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676970496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619910.348139:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619910.348189:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676970496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619910.348195:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788619910.348240:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc454a80 x1875503676970496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619910.348261:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676970496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619910.600446:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619911.623076:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788619912.200806:0:11474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:51:51 (1788619911) === 00000100:00100000:0.0:1788619912.391090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619912.391171:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009536 00000100:00100000:1.0:1788619912.391187:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009536 00000100:00100000:0.0:1788619912.391198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:0.0:1788619912.391262:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619912.391280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009664 00000100:00100000:3.0:1788619912.391288:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009664 00000100:00100000:1.0:1788619912.391293:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788619912.391308:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2357:x1875503657009536:12345-192.168.203.12@tcp:41:mkdir.0 00000100:00100000:3.0:1788619912.391341:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788619912.391351:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11f76a03-c7c3-4513-8603-309aac0577a7+7:9710:x1875503657009664:12345-192.168.203.12@tcp:700:mkdir.0 00000004:00000024:1.0:1788619912.391381:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788619912.391466:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11f76a03-c7c3-4513-8603-309aac0577a7+7:9710:x1875503657009664:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619912.391487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788619912.394465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657009536:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 3147us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619912.394499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788619912.399531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.399842:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657009920 00000100:00100000:0.0:1788619912.399862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657009920 00000100:00100000:0.0:1788619912.399942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788619912.399955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:9710:x1875503657009920:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:0.0:1788619912.400034:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619912.408445:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe097 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7f7 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.408470:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619912.408577:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619912.409372:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.409399:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.409410:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.409445:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.409452:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.409459:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619912.411404:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788619912.411427:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411440:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411449:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411456:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380030600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.411461:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411471:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411493:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385a000) 00010000:00010000:1.0:1788619912.411496:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.411501:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.411506:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619912.411542:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db7d5f3f reply state 00000000f2fe4d10 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619912.411552:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788619912.411760:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:9710:x1875503657009920:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 11801us (12247us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788619912.411812:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1788619912.414172:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414207:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414215:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414221:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380031c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619912.414227:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414236:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414261:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93338385aa00) 00010000:00010000:2.0:1788619912.414265:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619912.414271:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.414280:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1bd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619912.435007:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.436650:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010048 00000100:00100000:0.0:1788619912.436671:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010048 00000100:00100000:0.0:1788619912.436764:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788619912.436799:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:9711:x1875503657010048:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1788619912.436828:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619912.436869:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a87c expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.436954:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.436971:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.436985:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619912.437049:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788619912.437053:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619912.437106:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.437136:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a87c expref: 8 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.437154:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a87c expref: 7 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.437164:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385a300) 00010000:00010000:0.0:1788619912.437168:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619912.437172:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031c00, rc 0) 00000100:00100000:0.0:1788619912.437269:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:9711:x1875503657010048:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 495us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619912.437276:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788619912.442416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.443882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010304 00000100:00100000:2.0:1788619912.443989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010304 00000100:00100000:2.0:1788619912.444074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788619912.444088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:9711:x1875503657010304:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:2.0:1788619912.444315:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619912.444350:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe1cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a87c expref: 7 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.444385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385a300) 00010000:00010000:2.0:1788619912.444399:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619912.444431:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.444447:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.444459:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619912.447244:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cff446b0 reply state 00000000803dfa5d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619912.447270:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788619912.447286:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788619912.447435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:9711:x1875503657010304:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 3344us (5025us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788619912.447445:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00010000:1.0:1788619912.455741:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455766:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455835:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455844:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eac00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.455850:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455861:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455883:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fad00) 00010000:00010000:1.0:1788619912.455887:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788619912.455894:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.455902:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619912.504263:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.504351:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010432 00000100:00100000:2.0:1788619912.504371:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010432 00000100:00100000:2.0:1788619912.504467:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619912.504482:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:9712:x1875503657010432:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:2.0:1788619912.504535:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619912.504569:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a883 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504682:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504711:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504728:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619912.504819:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788619912.504824:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619912.504874:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504911:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a883 expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504931:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a883 expref: 8 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.504942:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fa300) 00010000:00010000:2.0:1788619912.504946:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619912.504950:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619912.505293:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:9712:x1875503657010432:12345-192.168.203.12@tcp:101:chown.0 Request processed in 814us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619912.505301:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788619912.518683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.519146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010560 00000100:00100000:3.0:1788619912.519163:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010560 00000100:00100000:3.0:1788619912.520620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788619912.520645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:9712:x1875503657010560:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:3.0:1788619912.520674:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619912.520703:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe1e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520805:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520825:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520838:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520857:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520864:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520872:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.520989:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521015:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521023:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619912.521064:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788619912.521069:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619912.521097:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521112:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521119:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521126:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521132:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619912.521137:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521145:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521159:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fa300) 00010000:00010000:3.0:1788619912.521163:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619912.521168:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521184:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe1ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521201:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521207:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521212:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521217:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619912.521220:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521226:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff933388291d00) 00010000:00010000:3.0:1788619912.521237:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619912.521240:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe1f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521282:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe1e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a88a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521297:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a88a expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.521311:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619912.521314:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619912.521317:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfe00, rc 0) 00000100:00100000:3.0:1788619912.521412:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:9712:x1875503657010560:12345-192.168.203.12@tcp:101:chown.0 Request processed in 777us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619912.521420:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788619912.527369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.527430:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010816 00000100:00100000:2.0:1788619912.527443:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010816 00000100:00100000:3.0:1788619912.527741:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788619912.527766:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:9712:x1875503657010816:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:3.0:1788619912.527860:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619912.527894:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe1fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a88a expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.527915:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619912.527928:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619912.527960:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.527975:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.527987:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619912.589026:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788619912.589060:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788619912.589065:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788619912.589250:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d010499 reply state 00000000fab83a59 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619912.589294:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788619912.589316:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788619912.589462:0:5841:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788619912.589489:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:9712:x1875503657010816:12345-192.168.203.12@tcp:36:chown.0 Request processed in 61723us (62130us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788619912.589500:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:1.0:1788619912.589903:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.589918:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.589942:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.589960:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.589967:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.589977:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.589998:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933388291500) 00010000:00010000:1.0:1788619912.590002:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788619912.590009:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.590017:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbe203 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619912.603675:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.604704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657010944 00000100:00100000:0.0:1788619912.604720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657010944 00000100:00100000:0.0:1788619912.604850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788619912.604862:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:9713:x1875503657010944:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1788619912.604892:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619912.604934:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe20a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a891 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788619912.606896:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1899us 00010000:00010000:0.0:1788619912.615373:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615401:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615416:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615436:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615444:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615452:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615822:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615833:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615841:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619912.615866:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788619912.615870:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619912.615914:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615934:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615942:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615950:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615956:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380030600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619912.615961:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615969:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615982:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fa300) 00010000:00010000:0.0:1788619912.615986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619912.615991:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.615998:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616011:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616018:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616024:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616034:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380031c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619912.616037:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616043:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616050:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93338385a500) 00010000:00010000:0.0:1788619912.616052:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619912.616055:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616062:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe218 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616104:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe20a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a891 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616118:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a891 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.616126:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:0.0:1788619912.616129:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788619912.616131:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030000, rc 0) 00000100:00100000:0.0:1788619912.616228:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:9713:x1875503657010944:12345-192.168.203.12@tcp:101:touch.500 Request processed in 11367us (12563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619912.616238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788619912.619314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.619399:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657011200 00000100:00100000:2.0:1788619912.619412:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657011200 00000100:00100000:2.0:1788619912.619481:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788619912.619492:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:9713:x1875503657011200:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1788619912.619526:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619912.619552:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe226 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a898 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.619907:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.619925:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.619938:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.622938:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.622962:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.622993:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788619912.623845:0:8707:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788619912.624128:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe23b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624140:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624150:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624182:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624189:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624195:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624201:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eae00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619912.624205:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624213:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624224:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:2.0:1788619912.624227:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619912.624239:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624246:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe22d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619912.624260:0:8707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004db6775f reply state 000000006565ca27 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619912.624268:0:8707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788619912.624299:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe226 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a898 expref: 10 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624313:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a898 expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619912.624321:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9333838fa500) 00010000:00010000:2.0:1788619912.624323:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619912.624325:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eaa00, rc 0) 00000100:00100000:2.0:1788619912.624396:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+10:9713:x1875503657011200:12345-192.168.203.12@tcp:101:touch.500 Request processed in 4906us (5094us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788619912.624404:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:1.0:1788619912.627836:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627860:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627870:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627877:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.627883:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627908:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627929:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff9333838fab00) 00010000:00010000:1.0:1788619912.627933:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.627939:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.627946:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe234 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619912.628725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.628818:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657011456 00000100:00100000:3.0:1788619912.628832:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657011456 00000100:00100000:3.0:1788619912.628894:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788619912.628906:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:9713:x1875503657011456:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:3.0:1788619912.628990:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619912.629017:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe23b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a898 expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.629050:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9333838fa500) 00010000:00010000:3.0:1788619912.629060:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619912.629117:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.629132:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.629152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619912.629332:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000259832b0 reply state 000000003748fe96 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619912.629342:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619912.629455:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+10:9713:x1875503657011456:12345-192.168.203.12@tcp:36:touch.500 Request processed in 550us (738us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788619912.629463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:1.0:1788619912.633461:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633487:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633496:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633503:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.633509:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633531:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633554:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933388291d00) 00010000:00010000:1.0:1788619912.633558:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.633565:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.633597:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe249 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619912.635184:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.635298:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657011584 00000100:00100000:3.0:1788619912.635311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657011584 00000100:00100000:3.0:1788619912.635386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788619912.635398:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:9713:x1875503657011584:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:3.0:1788619912.635434:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619912.635460:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a89f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.635570:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a89f expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.635587:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a89f expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.635609:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619912.635612:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619912.635617:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfc00, rc 0) 00000100:00100000:3.0:1788619912.635708:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+10:9713:x1875503657011584:12345-192.168.203.12@tcp:101:touch.500 Request processed in 310us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619912.635717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788619912.638118:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.638279:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657011712 00000100:00100000:0.0:1788619912.638292:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657011712 00000100:00100000:0.0:1788619912.638422:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788619912.638432:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875503657011712:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:0.0:1788619912.638476:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1788619912.638537:0:6692:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe257 00002000:00100000:0.0:1788619912.638627:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11f76a03-c7c3-4513-8603-309aac0577a7/ffff9333c1e06800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788619912.638657:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788619912.639125:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788619912.639178:0:6692:0:(import.c:65:import_set_state_nolock()) ffff933284da6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788619912.639268:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503657011712:12345-192.168.203.12@tcp:8:touch.500 Request processed in 834us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619912.639277:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788619912.641946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.641997:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657011840 00000100:00100000:2.0:1788619912.642009:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657011840 00000100:00100000:2.0:1788619912.642085:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619912.642095:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:0:x1875503657011840:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:0.0:1788619912.642140:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788619912.647404:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788619912.672370:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000001:00080000:1.0:1788619912.672401:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788619912.672604:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+5:0:x1875503657011840:12345-192.168.203.12@tcp:2:touch.500 Request processed in 30501us (30666us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788619912.672618:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619912.676375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619912.676490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657012096 00000100:00100000:1.0:1788619912.676504:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657012096 00000100:00100000:1.0:1788619912.676590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788619912.676601:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+10:9713:x1875503657012096:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:1.0:1788619912.677325:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+11:9713:x1875503657012096:12345-192.168.203.12@tcp:35:touch.500 Request processed in 721us (960us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788619912.677335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788619912.694079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.694309:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657012224 00000100:00100000:3.0:1788619912.694322:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657012224 00000100:00100000:3.0:1788619912.694399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788619912.694411:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+11:9714:x1875503657012224:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1788619912.694442:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619912.694472:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf800/0xbb0e330328bbe25e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8a6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.694571:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.694588:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.694602:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619912.694657:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788619912.694661:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619912.694709:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.695041:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf800/0xbb0e330328bbe25e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8a6 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.695175:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8a6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.695186:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:3.0:1788619912.695189:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619912.695193:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf600, rc 0) 00000100:00100000:2.0:1788619912.695451:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:9714:x1875503657012224:12345-192.168.203.12@tcp:101:rm.0 Request processed in 1040us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619912.695460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788619912.700273:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.700368:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657012480 00000100:00100000:3.0:1788619912.700381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657012480 00000100:00100000:3.0:1788619912.700510:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788619912.700532:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+12:9714:x1875503657012480:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1788619912.700560:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619912.700591:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe26c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8ad expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619912.700881:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788619912.701239:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe26c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8ad expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.701256:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fa300) 00010000:00010000:3.0:1788619912.701266:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619912.701273:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe26c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8ad expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.701291:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfe00, rc 0) 00000100:00100000:3.0:1788619912.701430:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:9714:x1875503657012480:12345-192.168.203.12@tcp:101:rm.0 Request processed in 900us (1170us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788619912.701439:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788619912.706459:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619912.706568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657012608 00000100:00100000:3.0:1788619912.706581:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657012608 00000100:00100000:3.0:1788619912.706688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788619912.706700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:9714:x1875503657012608:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:2.0:1788619912.714907:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:9714:x1875503657012608:12345-192.168.203.12@tcp:37:rm.0 Request processed in 8192us (8445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619912.714933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788619912.726535:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.726911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657012864 00000100:00100000:2.0:1788619912.726921:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657012864 00000100:00100000:2.0:1788619912.726976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788619912.726987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933385922c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:9714:x1875503657012864:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1788619912.727217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933385922c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:9714:x1875503657012864:12345-192.168.203.12@tcp:35:rm.0 Request processed in 231us (700us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788619912.727224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788619912.733546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.733657:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657013120 00000100:00100000:0.0:1788619912.733666:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657013120 00000100:00100000:0.0:1788619912.733722:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788619912.733732:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:9714:x1875503657013120:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1788619912.733937:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619912.733961:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe27a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.734057:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe281 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.734072:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe281 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.734084:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe281 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619912.734095:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788619912.734224:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe27a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8b4 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.734245:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe281 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8b4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.734254:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:0.0:1788619912.734257:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619912.734261:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031c00, rc 0) 00000100:00100000:0.0:1788619912.734313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013120:12345-192.168.203.12@tcp:101:rm.0 Request processed in 583us (776us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788619912.734321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788619912.741459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619912.741672:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657013248 00000100:00100000:2.0:1788619912.741686:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657013248 00000100:00100000:2.0:1788619912.741763:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788619912.741822:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013248:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:2.0:1788619912.741902:0:8707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788619912.742002:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013248:12345-192.168.203.12@tcp:41:rm.0 Request processed in 229us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619912.742011:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788619912.747278:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619912.747859:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657013376 00000100:00100000:0.0:1788619912.747877:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657013376 00000100:00100000:0.0:1788619912.747991:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788619912.748004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013376:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1788619912.748032:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619912.748249:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe28f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748343:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748361:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748376:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748415:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748423:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748431:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748570:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748589:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.748597:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619912.748642:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788619912.748647:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619912.749376:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749398:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749410:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749417:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749425:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749431:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380030600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619912.749435:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749445:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749461:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:0.0:1788619912.749464:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619912.749469:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749476:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030600/0xbb0e330328bbe296 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749508:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749514:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749530:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749535:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619912.749539:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749545:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749552:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff93338385a500) 00010000:00010000:0.0:1788619912.749554:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619912.749557:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749562:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe29d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749609:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030400/0xbb0e330328bbe28f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8bb expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749625:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8bb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619912.749644:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933388291b00) 00010000:00010000:0.0:1788619912.749646:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619912.749649:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:1.0:1788619912.759597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+17:9714:x1875503657013376:12345-192.168.203.12@tcp:101:rm.0 Request processed in 11573us (12305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619912.759615:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788619912.764612:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619912.764726:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657013632 00000100:00100000:1.0:1788619912.764741:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657013632 00000100:00100000:1.0:1788619912.764837:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788619912.764848:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+17:9714:x1875503657013632:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788619912.765271:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788619912.765308:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbe2a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8bb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765364:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a89f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765378:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933388291b00) 00010000:00010000:1.0:1788619912.765397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe265 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8a6 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765405:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:1.0:1788619912.765409:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619912.765437:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765464:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765482:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765490:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765498:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.765657:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.766369:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.766379:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788619912.768407:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788619912.768431:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315736658161ns, next at 316736653084ns, rc = 0 00010000:00010000:1.0:1788619912.768557:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768578:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768594:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768604:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768611:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768617:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.768643:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788619912.768895:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619912.768904:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.768912:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fa00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788619912.768917:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.768937:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.768954:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933390117900) 00010000:00010000:3.0:1788619912.768958:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788619912.768963:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.768970:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe2c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619912.769005:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619912.769007:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619912.769009:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619912.769417:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769428:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769443:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769449:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.769453:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769460:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769470:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619912.769473:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788619912.769477:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769482:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769508:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769514:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769531:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769536:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.769539:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769556:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769564:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:1.0:1788619912.769567:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.769570:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.769577:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619912.769589:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000889a736d reply state 000000007d0374b1 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619912.769600:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788619912.770498:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013632:12345-192.168.203.12@tcp:36:rm.0 Request processed in 5640us (5889us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788619912.770511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00010000:00010000:1.0:1788619912.775429:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775454:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775464:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775471:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.775477:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775486:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775541:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa6743ac4 (ffff933390117a00) 00010000:00010000:1.0:1788619912.775545:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.775552:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.775559:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fe00/0xbb0e330328bbe2b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa6743ac4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619912.776916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619912.777604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657013888 00000100:00100000:1.0:1788619912.777618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657013888 00000100:00100000:1.0:1788619912.777697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788619912.777709:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:9714:x1875503657013888:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:1.0:1788619912.778560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657013888:12345-192.168.203.12@tcp:35:rm.0 Request processed in 847us (1652us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788619912.778571:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788619912.782401:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619912.782497:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014144 00000100:00100000:1.0:1788619912.782511:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014144 00000100:00100000:1.0:1788619912.782597:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788619912.782609:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:9714:x1875503657014144:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788619912.782700:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788619912.782734:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031c00/0xbb0e330328bbe281 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8b4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782762:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030000/0xbb0e330328bbe21f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a891 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782824:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93338385ac00) 00010000:00010000:1.0:1788619912.782870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe1e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a883 expref: 14 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782881:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9333838fa300) 00010000:00010000:1.0:1788619912.782888:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619912.782919:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782936:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782948:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782964:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782972:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.782978:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.783379:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.783390:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.783398:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619912.785487:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788619912.785545:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785557:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785565:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785571:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18ee00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.785576:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785586:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785606:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933390117200) 00010000:00010000:1.0:1788619912.785610:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788619912.785616:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe2d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785657:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.785663:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.786295:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.786302:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.786317:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.786325:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.786339:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619912.786342:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.786346:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.786353:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe2c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619912.786373:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c606249 reply state 000000009c284f17 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619912.786385:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619912.786695:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+15:9714:x1875503657014144:12345-192.168.203.12@tcp:36:rm.0 Request processed in 4080us (4301us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788619912.786722:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:1.0:1788619912.805093:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805118:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805127:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805134:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619912.805141:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805150:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805201:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff933390117700) 00010000:00010000:1.0:1788619912.805204:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619912.805211:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619912.805219:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe2ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619913.672297:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619914.148092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619914.148156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619914.148220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014272 00000100:00100000:2.0:1788619914.148230:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014272 00000100:00100000:2.0:1788619914.148282:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:2.0:1788619914.148292:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657014272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619914.148360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657014272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619914.148369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:3.0:1788619914.149862:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014528 00000100:00100000:3.0:1788619914.149875:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014528 00000100:00080000:2.0:1788619914.149928:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619914.149969:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788619914.149981:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657014528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619914.150055:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657014528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619914.150063:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788619914.154600:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619914.154655:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619914.154682:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014400 00000100:00100000:0.0:1788619914.154692:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014400 00000100:00100000:0.0:1788619914.154747:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014656 00000100:00100000:0.0:1788619914.154751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014656 00000100:00100000:0.0:1788619914.154806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788619914.154816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:2357:x1875503657014400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619914.154889:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:2357:x1875503657014400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619914.154897:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788619914.154913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788619914.154920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657014656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619914.154948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657014656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619914.154954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00080000:0.0:1788619914.154971:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619914.445347:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676971008:0@lo:400:kworker.0 00000100:00100000:2.0:1788619914.445417:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619914.445479:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788619914.445486:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676970880:0@lo:400:kworker.0 00000100:00100000:2.0:1788619914.445522:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619914.445553:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971008 00000100:00100000:2.0:1788619914.445561:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971008 00000100:00100000:2.0:1788619914.445614:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788619914.445623:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619914.446036:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676970624:0@lo:400:kworker.0 00000100:00100000:1.0:1788619914.446187:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676970752:0@lo:400:kworker.0 00000100:00100000:0.0:1788619914.458845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619914.458911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676971136:0@lo:400:kworker.0 00000100:00100000:1.0:1788619914.459284:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619914.459748:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676971008:12345-0@lo:400:kworker.0 Request processed in 14121us (14326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619914.459761:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788619914.459845:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333908a5500 x1875503676971008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619914.459861:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676971008:0@lo:400:kworker.0 00000100:00100000:3.0:1788619914.459918:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970624 00000100:00080000:2.0:1788619914.459921:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619914.459927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970624 00000100:00100000:1.0:1788619914.459941:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676971264:0@lo:400:kworker.0 00000100:00100000:2.0:1788619914.459973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970880 00000100:00100000:2.0:1788619914.459980:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970880 00000100:00100000:3.0:1788619914.459983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788619914.460005:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619914.460016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676970624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619914.460039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676970752 00000100:00100000:2.0:1788619914.460045:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676970752 00000100:00100000:2.0:1788619914.460072:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788619914.460085:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676970624:12345-0@lo:400:kworker.0 Request processed in 89us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619914.460085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676970880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619914.460098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788619914.460138:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676970880:12345-0@lo:400:kworker.0 Request processed in 58us (14615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619914.460144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788619914.460154:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676970752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619914.460195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676970752:12345-0@lo:400:kworker.0 Request processed in 43us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619914.460203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619914.460228:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676970624:0@lo:400:kworker.0 00000100:00100000:1.0:1788619914.460598:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676970752:0@lo:400:kworker.0 00000100:00100000:2.0:1788619914.464486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788619914.464524:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788619914.464568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971136 00000100:00100000:3.0:1788619914.464576:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971136 00000100:00100000:3.0:1788619914.464619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788619914.464629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676971136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619914.464748:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676971136:12345-0@lo:400:kworker.0 Request processed in 120us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619914.464755:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788619914.464890:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619914.464950:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676970880:0@lo:400:kworker.0 00000100:00100000:0.0:1788619914.465693:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971264 00000100:00100000:0.0:1788619914.465700:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971264 00000100:00100000:0.0:1788619914.465746:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788619914.465755:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619914.465838:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676971264:12345-0@lo:400:kworker.0 Request processed in 84us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619914.465845:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788619914.465868:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788619914.465894:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676971136:0@lo:400:kworker.0 00010000:00080000:0.0:1788619914.465926:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333908a6d80 x1875503676971264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619914.465951:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676971264:0@lo:400:kworker.0 00010000:00010000:2.0:1788619914.697060:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788619914.951792:0:8001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317919993279ns, next at 318919989844ns, rc = 0 00000100:00100000:3.0:1788619914.951811:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676971392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619914.952012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619914.952148:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971392 00000100:00100000:2.0:1788619914.952159:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971392 00000100:00100000:2.0:1788619914.952219:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788619914.952229:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676971392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619914.952276:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619914.952335:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676971392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619914.952342:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788619914.952533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338715f480 x1875503676971392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619914.952557:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676971392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619915.463078:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676971520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619915.463169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619915.463301:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971520 00000100:00100000:3.0:1788619915.463312:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971520 00000100:00100000:3.0:1788619915.463378:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788619915.463388:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676971520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619915.463436:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619915.463510:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676971520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619915.463518:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788619915.463608:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc045500 x1875503676971520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619915.463631:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676971520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619915.718992:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619916.744055:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788619916.893095:0:11627:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788619917.767977:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788619918.057546:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:1.0:1788619918.057568:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788619918.057582:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788619918.057590:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788619918.059013:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676971648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788619918.059081:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619918.059798:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676971648 00000100:00100000:3.0:1788619918.059807:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676971648 00000100:00100000:3.0:1788619918.059880:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788619918.059890:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676971648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788619918.059918:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788619918.059956:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c2c89, atime: 0x6a9c2c89, ctime: 0x6a9c2c89, blocks: 0x1 00010000:00010000:3.0:1788619918.059964:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.059981:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1788619918.059993:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619918.059999:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.060017:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.060028:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.060036:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.060056:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788619918.061879:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619918.062045:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875503676971648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2152us (2957us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788619918.062057:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:2.0:1788619918.062718:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93338715d500/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788619918.062728:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676971648:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788619918.062747:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619918.062755:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.062796:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619918.062801:0:7635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.062811:0:7635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.062899:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.062907:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbe2dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.062932:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619918.062933:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619918.062935:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788619918.159965:0:11677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff9c7e560 20000000:00000080:0.0:1788619918.159982:0:11677:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9333bc406000 uarg=0000000000000000 20000000:01000000:0.0:1788619918.160019:0:11677:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788619918.160031:0:11677:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788619918.160035:0:11677:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788619918.161965:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788619918.162503:0:11677:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788619918.169186:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788619918.169247:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788619918.169999:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788619918.170022:0:11677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788619918.170043:0:11677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170061:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170069:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170076:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170084:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170091:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170097:0:11677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170135:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.170163:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 12 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.170177:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676971776:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619918.171951:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.172827:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.172846:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676971904:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619918.174152:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.174168:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 18 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.174180:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972032:0@lo:104: 00000100:00100000:0.0:1788619918.174219:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788619918.175256:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.175543:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 18 pid: 5833 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.175558:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972160:0@lo:104: 00000100:00100000:3.0:1788619918.175569:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972032 00000100:00100000:3.0:1788619918.175578:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972032 00000100:00100000:0.0:1788619918.175602:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619918.175693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619918.175719:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014784 00000100:00100000:1.0:1788619918.175722:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014784 00010000:00010000:1.0:1788619918.175745:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 13 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.175790:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788619918.175800:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657014784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619918.175813:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619918.175819:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 13 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.175831:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 13 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.175849:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619918.175890:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657014784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619918.175897:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00010000:00010000:0.0:1788619918.176569:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619918.176580:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 18 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.176591:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972288:0@lo:104: 00000100:00100000:0.0:1788619918.176624:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619918.185291:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406840 going to sleep for 11 seconds 00010000:00010000:0.0:1788619918.185332:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031800/0xbb0e330328bbe1af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a875 expref: 12 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.185349:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676971776:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619918.185665:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788619918.185685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972160 00000100:00100000:2.0:1788619918.185691:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972160 00000100:00100000:2.0:1788619918.186220:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972288 00000100:00100000:2.0:1788619918.186225:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972288 00000100:00100000:2.0:1788619918.186249:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788619918.186258:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+5:11677:x1875503676972032:12345-0@lo:104: 00010000:00010000:2.0:1788619918.186274:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.186378:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788619918.186385:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+5:11677:x1875503676972032:12345-0@lo:104: Request processed in 128us (12167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619918.186391:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788619918.186495:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619918.186503:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619918.186510:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972032:0@lo:104: 00010000:00010000:1.0:1788619918.186515:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619918.186521:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.186529:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619918.186547:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619918.186553:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788619918.186562:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788619918.186570:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+4:11677:x1875503676972160:12345-0@lo:104: 00000100:00100000:3.0:1788619918.186620:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1788619918.186626:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788619918.186647:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788619918.187094:0:11679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788619918.187103:0:11679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42040134-1c22-4778-8507-c9e1e3983208+4:11677:x1875503676972288:12345-0@lo:104: 00010000:00010000:2.0:1788619918.197368:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197524:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788619918.197536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42040134-1c22-4778-8507-c9e1e3983208+4:11677:x1875503676972160:12345-0@lo:104: Request processed in 10962us (21929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619918.197549:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788619918.197593:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619918.197600:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197608:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788619918.197613:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197622:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788619918.197630:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619918.197636:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788619918.197702:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197709:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788619918.197734:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197741:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813ce000/0xbb0e330328bbe18c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.197758:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619918.197762:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619918.197765:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619918.197805:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619918.197820:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676972544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788619918.197875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619918.198016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619918.198049:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972544 00000100:00100000:2.0:1788619918.198056:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972544 00010000:00010000:2.0:1788619918.198085:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 19 pid: 5833 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619918.198119:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657014912 00000100:00100000:2.0:1788619918.198123:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657014912 00010000:00010000:2.0:1788619918.198139:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619918.198168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788619918.198178:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676972544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788619918.198190:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619918.198205:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 19 pid: 5833 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.198216:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 19 pid: 5833 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.198236:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619918.198277:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676972544:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619918.198286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788619918.198311:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788619918.198320:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387307050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:2354:x1875503657014912:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619918.198329:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619918.198335:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.198350:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 12 pid: 5834 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619918.198364:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619918.198404:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387307050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:2354:x1875503657014912:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 85us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619918.198413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788619918.198522:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676972544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619918.200009:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.200024:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619918.200066:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.200075:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eb400/0xbb0e330328bbe19a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe1a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.200113:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619918.200129:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676972416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619918.200345:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619918.200398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972416 00000100:00100000:1.0:1788619918.200406:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972416 00010000:00010000:1.0:1788619918.200437:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.200462:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788619918.200470:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676972416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619918.200494:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619918.200500:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.200513:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.200543:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18f400/0xbb0e330328bbe1a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe19a expref: 19 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.200555:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619918.200588:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+18:3312:x1875503676972416:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619918.200595:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788619918.200630:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676972416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619918.200760:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619918.200763:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619918.200765:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619918.200853:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe1a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a86e expref: 11 pid: 5834 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.200864:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676971904:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619918.200876:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031400/0xbb0e330328bbe193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe18c expref: 17 pid: 5833 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.200885:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972160:0@lo:104: 00010000:00010000:3.0:1788619918.201082:0:11679:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.201141:0:11679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788619918.201257:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875503676972288:0@lo:104: 00000100:00100000:3.0:1788619918.201279:0:11679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42040134-1c22-4778-8507-c9e1e3983208+3:11677:x1875503676972288:12345-0@lo:104: Request processed in 14176us (24653us total) trans 0 rc 0/0 00010000:00010000:1.0:1788619918.201286:0:11677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619918.201289:0:11679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788619918.201311:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619918.201318:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.201336:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380031000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788619918.201341:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.201350:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788619918.201357:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619918.201363:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788619918.201403:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.201410:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788619918.201431:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.201438:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff933380031000/0xbb0e330328bbe17e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbe185 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.201452:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619918.201455:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619918.201468:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619918.201501:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676972672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619918.201533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619918.202684:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972672 00000100:00100000:1.0:1788619918.202695:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972672 00010000:00010000:1.0:1788619918.202727:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619918.202924:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788619918.202944:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+17:3312:x1875503676972672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788619918.202958:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619918.202964:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.202976:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.202993:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbe185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbe17e expref: 17 pid: 5834 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203007:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203015:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203030:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203037:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203044:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203051:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203058:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788619918.203062:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.203077:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.213055:0:11677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619918.213074:0:11677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.215994:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.216023:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbe2e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619918.216056:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619918.216168:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42040134-1c22-4778-8507-c9e1e3983208+16:3312:x1875503676972672:12345-0@lo:103:ldlm_bl.0 Request processed in 13215us (14623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619918.216178:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788619918.225082:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676972672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788619918.791015:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619919.259550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.259618:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.259654:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.259692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.259728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015168 00000100:00100000:3.0:1788619919.259743:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015168 00000100:00100000:3.0:1788619919.259856:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015424 00000100:00100000:3.0:1788619919.259861:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015424 00000100:00100000:3.0:1788619919.259890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788619919.259901:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657015168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619919.259997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657015168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.260020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788619919.260040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788619919.260049:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657015424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619919.260098:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657015424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619919.260099:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015296 00000100:00100000:3.0:1788619919.260111:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788619919.260119:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015296 00000100:00080000:3.0:1788619919.260168:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788619919.260175:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619919.260207:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788619919.260218:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657015296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619919.260291:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657015296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619919.260299:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788619919.260387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015040 00000100:00100000:2.0:1788619919.260394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015040 00000100:00100000:2.0:1788619919.260437:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:2.0:1788619919.260445:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2354:x1875503657015040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619919.260502:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2354:x1875503657015040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.260509:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:1.0:1788619919.517133:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.520100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015552 00000100:00100000:3.0:1788619919.520120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015552 00000100:00100000:3.0:1788619919.520212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:3.0:1788619919.520223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:5598:x1875503657015552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619919.520245:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619919.520270:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cf800/0xbb0e330328bbe2ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8c2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.520309:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cf800/0xbb0e330328bbe2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c2 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.520323:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cf800/0xbb0e330328bbe2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c2 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.520334:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf800, rc 0) 00000100:00100000:3.0:1788619919.520422:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657015552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 201us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.520430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:2.0:1788619919.523157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.523461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015680 00000100:00100000:3.0:1788619919.523483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015680 00000100:00100000:3.0:1788619919.523550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1788619919.523563:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657015680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619919.525256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657015680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 1683us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.525272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:0.0:1788619919.533945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619919.534446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015808 00000100:00100000:2.0:1788619919.534460:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015808 00000100:00100000:2.0:1788619919.534548:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:2.0:1788619919.534561:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657015808:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619919.535581:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657015808:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 1013us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.535595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:1.0:1788619919.547547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.547923:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657015936 00000100:00100000:3.0:1788619919.547936:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657015936 00000100:00100000:3.0:1788619919.548012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:3.0:1788619919.548023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:9984:x1875503657015936:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788619919.548513:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333ace87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:9984:x1875503657015936:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 489us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.548523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:0.0:1788619919.552337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.557402:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016064 00000100:00100000:3.0:1788619919.557425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016064 00000100:00100000:2.0:1788619919.560455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:2.0:1788619919.560502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:9984:x1875503657016064:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788619919.560892:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:9984:x1875503657016064:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 418us (8570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.560901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:3.0:1788619919.561488:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676973056:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.561555:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619919.561639:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619919.561646:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676973184:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.561675:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619919.561723:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973184 00000100:00100000:3.0:1788619919.561732:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973184 00000100:00100000:3.0:1788619919.561808:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788619919.561818:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676973184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.561866:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676973184:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.561873:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788619919.561916:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386712a00 x1875503676973184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619919.561948:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676973184:0@lo:400:kworker.0 00000100:00080000:3.0:1788619919.561974:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619919.561989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973056 00000100:00100000:3.0:1788619919.561992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973056 00000100:00100000:3.0:1788619919.562031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788619919.562037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676973056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.562074:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676973056:12345-0@lo:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.562080:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788619919.562098:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619919.562114:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676973056:0@lo:400:kworker.0 00000100:00100000:1.0:1788619919.562520:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676972800:0@lo:400:kworker.0 00000100:00100000:1.0:1788619919.562566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619919.563120:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676972928:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.563159:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619919.563202:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676973440:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.563227:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619919.563275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972928 00000100:00100000:3.0:1788619919.563281:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972928 00000100:00100000:3.0:1788619919.563322:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788619919.563330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676972928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.567865:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676972928:12345-0@lo:400:kworker.0 Request processed in 4518us (4687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.567887:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788619919.567996:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676972928:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.568557:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973440 00000100:00100000:3.0:1788619919.568589:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973440 00000100:00100000:3.0:1788619919.568659:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788619919.568669:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676973440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.569028:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676973440:12345-0@lo:400:kworker.0 Request processed in 357us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.569036:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788619919.569094:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676973440:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.570957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619919.571337:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676973312:0@lo:400:kworker.0 00000100:00100000:1.0:1788619919.571425:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619919.571456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973312 00000100:00100000:1.0:1788619919.571465:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973312 00000100:00100000:1.0:1788619919.571547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788619919.571556:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676973312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619919.571614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676973312:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619919.571632:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788619919.571998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676972800 00000100:00100000:0.0:1788619919.572006:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676972800 00000100:00100000:0.0:1788619919.572044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788619919.572052:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676972800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619919.572106:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+16:3309:x1875503676972800:12345-0@lo:400:kworker.0 Request processed in 54us (9538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619919.572132:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1788619919.572291:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619919.572337:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676973312:0@lo:400:kworker.0 00000100:00100000:1.0:1788619919.572379:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676972800:0@lo:400:kworker.0 00000100:00100000:3.0:1788619919.572579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016192 00000100:00100000:3.0:1788619919.572585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016192 00000100:00100000:3.0:1788619919.572614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:3.0:1788619919.572632:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:5598:x1875503657016192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788619919.572646:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619919.572678:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813ce400/0xbb0e330328bbe2f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.572711:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813ce400/0xbb0e330328bbe2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c9 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.572734:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813ce400/0xbb0e330328bbe2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c9 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619919.572745:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce400, rc 0) 00000100:00100000:3.0:1788619919.573013:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657016192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 390us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619919.573020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:1.0:1788619919.583275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619919.587635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016320 00000100:00100000:3.0:1788619919.587940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016320 00000100:00100000:2.0:1788619919.588311:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:2.0:1788619919.588325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657016320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619919.590055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657016320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 1721us (6860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.590070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:0.0:1788619919.605430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619919.605663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016448 00000100:00100000:2.0:1788619919.606106:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016448 00000100:00100000:2.0:1788619919.606268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:2.0:1788619919.606299:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657016448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619919.606614:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:5598:x1875503657016448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 317us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.607017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:3.0:1788619919.614084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619919.627104:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016576 00000100:00100000:0.0:1788619919.627126:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016576 00000100:00100000:0.0:1788619919.627256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:0.0:1788619919.627268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:9987:x1875503657016576:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788619919.629623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:9987:x1875503657016576:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 2341us (15541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619919.629641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:1.0:1788619919.635196:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619919.639939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016704 00000100:00100000:2.0:1788619919.639953:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016704 00000100:00100000:2.0:1788619919.640029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:2.0:1788619919.640045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:9987:x1875503657016704:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788619919.640296:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:9987:x1875503657016704:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 257us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619919.640305:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 262 00010000:00010000:2.0:1788619919.821540:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788619920.008823:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788619920.008830:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333861ca800 from 7 10000000:01000000:0.0:1788619920.008834:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788619920.008885:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.008897:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.008907:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619920.008932:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.009001:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.009068:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.009326:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973568 00000100:00100000:1.0:1788619920.009335:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973568 00000100:00100000:1.0:1788619920.009386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788619920.009395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+16:5837:x1875503676973568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619920.009406:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619920.009419:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe2ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe2f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.009442:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe2f8 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.009452:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe2f8 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.009461:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fe00, rc 0) 00000100:00100000:1.0:1788619920.009516:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676973568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.009523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788619920.009608:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619920.009623:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.009649:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619920.009704:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.009728:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.009750:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406600 going to sleep for 11 seconds 00000100:00100000:3.0:1788619920.010350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973696 00000100:00100000:3.0:1788619920.010356:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973696 00000100:00100000:3.0:1788619920.010397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788619920.010405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676973696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788619920.010663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676973696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619920.010670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788619920.010751:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.010805:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.010841:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.010876:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406600 going to sleep for 11 seconds 00000100:00100000:3.0:1788619920.010974:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973824 00000100:00100000:3.0:1788619920.010978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973824 00000100:00100000:3.0:1788619920.011008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788619920.011015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676973824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619920.011157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676973824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619920.011164:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788619920.011376:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676973824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619920.011792:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11691:1875503676973952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619920.011834:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619920.011954:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430780 going to sleep for 11 seconds 00000100:00100000:2.0:1788619920.012225:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676973952 00000100:00100000:2.0:1788619920.012230:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676973952 00000100:00100000:2.0:1788619920.012267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788619920.012275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:11691:x1875503676973952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788619920.012433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+17:11691:x1875503676973952:12345-0@lo:502:llog_process_th.0 Request processed in 159us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619920.012440:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788619920.012575:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11691:1875503676973952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788619920.012600:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788619920.012610:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619920.012612:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788619920.012618:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9333861ca800 00000020:00000080:0.0:1788619920.012621:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788619920.012722:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11691:1875503676974080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619920.012755:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.012802:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406600 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.014597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974080 00000100:00100000:1.0:1788619920.014609:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974080 00000100:00100000:1.0:1788619920.014660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788619920.014670:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:11691:x1875503676974080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619920.014928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:11691:x1875503676974080:12345-0@lo:502:llog_process_th.0 Request processed in 258us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.014941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788619920.017081:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11691:1875503676974080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788619920.017121:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788619920.017129:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788619920.017131:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788619920.017141:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788619920.020054:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788619920.020092:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788619920.020105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.020118:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619920.020127:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788619920.020130:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bbf76000 from 7 10000000:01000000:1.0:1788619920.020133:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619920.020171:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.020179:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.020189:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619920.020213:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788619920.020278:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619920.020323:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.020427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974208 00000100:00100000:0.0:1788619920.020434:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974208 00000100:00100000:0.0:1788619920.020486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788619920.020497:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+17:5837:x1875503676974208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619920.020510:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619920.020522:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3800/0xbb0e330328bbe30d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe306 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.020542:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3800/0xbb0e330328bbe30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe306 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.020552:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c3800/0xbb0e330328bbe30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe306 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.020560:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3800, rc 0) 00000100:00100000:0.0:1788619920.020607:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.020613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788619920.021377:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788619920.021393:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619920.021404:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619920.021495:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619920.021528:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619920.021565:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440180 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.021622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974336 00000100:00100000:0.0:1788619920.021627:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974336 00000100:00100000:0.0:1788619920.021672:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788619920.021679:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.021934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333874e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.021941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788619920.022152:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788619920.022179:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788619920.022210:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619920.022235:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440180 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.024814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974464 00000100:00100000:1.0:1788619920.024829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974464 00000100:00100000:1.0:1788619920.024895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788619920.024904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619920.025142:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.025152:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788619920.025197:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788619920.025428:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11693:1875503676974592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619920.025478:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619920.025499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974592 00000100:00100000:1.0:1788619920.025503:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974592 00000100:00100000:1.0:1788619920.025519:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788619920.025525:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:11693:x1875503676974592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619920.025639:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:11693:x1875503676974592:12345-0@lo:502:llog_process_th.0 Request processed in 114us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.025646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788619920.025686:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.025697:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11693:1875503676974592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788619920.025716:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788619920.025725:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619920.025727:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788619920.025734:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9333bbf76000 00000020:00000080:1.0:1788619920.025737:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788619920.025822:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11693:1875503676974720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619920.025854:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619920.025872:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974720 00000100:00100000:1.0:1788619920.025875:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974720 00000100:00100000:1.0:1788619920.025897:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788619920.025903:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:11693:x1875503676974720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788619920.026007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:11693:x1875503676974720:12345-0@lo:502:llog_process_th.0 Request processed in 104us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.026020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788619920.026053:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.026065:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11693:1875503676974720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788619920.026083:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788619920.026087:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788619920.026088:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788619920.026092:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788619920.026154:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788619920.026173:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788619920.026183:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026194:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788619920.026203:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788619920.026206:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93338a7b5000 from 7 10000000:01000000:1.0:1788619920.026209:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788619920.026232:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026239:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026248:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619920.026262:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788619920.026290:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619920.026308:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fa9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619920.026320:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974848 00000100:00100000:1.0:1788619920.026324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974848 00000100:00100000:1.0:1788619920.026346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788619920.026353:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+18:5837:x1875503676974848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788619920.026361:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619920.026373:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe31b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbe314 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026393:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbe314 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026404:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbe314 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619920.026414:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18ec00, rc 0) 00000100:00100000:1.0:1788619920.026457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676974848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.026463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788619920.026613:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788619920.026625:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.026642:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619920.026684:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.026709:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.026723:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.026734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676974976 00000100:00100000:0.0:1788619920.026737:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676974976 00000100:00100000:0.0:1788619920.026759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788619920.026765:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676974976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.026977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676974976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.026983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788619920.027022:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.027046:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.027077:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619920.027089:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.027101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975104 00000100:00100000:0.0:1788619920.027104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975104 00000100:00100000:0.0:1788619920.027120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788619920.027125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676975104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788619920.027235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:5837:x1875503676975104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.027240:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788619920.027278:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42040134-1c22-4778-8507-c9e1e3983208:5837:1875503676975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788619920.028196:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11695:1875503676975232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619920.028242:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619920.028279:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.028933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975232 00000100:00100000:0.0:1788619920.028942:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975232 00000100:00100000:0.0:1788619920.028986:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788619920.028995:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:11695:x1875503676975232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619920.029204:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:11695:x1875503676975232:12345-0@lo:502:llog_process_th.0 Request processed in 196us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.029212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788619920.030032:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11695:1875503676975232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619920.030065:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788619920.030075:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619920.030078:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788619920.030091:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93338a7b5000 00000020:00000080:3.0:1788619920.030094:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788619920.030179:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11695:1875503676975360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788619920.030222:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619920.030246:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619920.030813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975360 00000100:00100000:0.0:1788619920.030820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975360 00000100:00100000:0.0:1788619920.031438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788619920.031449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:11695:x1875503676975360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788619920.032206:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:11695:x1875503676975360:12345-0@lo:502:llog_process_th.0 Request processed in 758us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619920.032214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788619920.032311:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42040134-1c22-4778-8507-c9e1e3983208:11695:1875503676975360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788619920.032342:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788619920.032350:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788619920.032352:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788619920.032356:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788619920.032742:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788619920.032762:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788619920.032800:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619920.032813:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788619920.051374:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788619920.071493:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676975488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619920.071563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619920.071745:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975488 00000100:00100000:1.0:1788619920.071752:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975488 00000100:00100000:1.0:1788619920.071860:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788619920.071870:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676975488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619920.071907:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619920.071954:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676975488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619920.071960:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788619920.072108:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676975488:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788619920.072254:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788619920.585215:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619920.585246:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676975616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619920.585342:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619920.585546:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975616 00000100:00100000:3.0:1788619920.585558:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975616 00000100:00100000:3.0:1788619920.585622:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788619920.585632:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676975616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619920.585677:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619920.585741:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676975616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619920.585748:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788619920.586699:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386710000 x1875503676975616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619920.586730:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676975616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619920.841682:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788619921.097257:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788619921.863062:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619922.887002:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788619923.210616:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788619923.911008:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619924.380906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619924.381158:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619924.381192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619924.381239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016832 00000100:00100000:1.0:1788619924.381249:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016832 00000100:00100000:1.0:1788619924.381312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:1.0:1788619924.381323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657016832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619924.381394:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657016832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619924.381402:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:3.0:1788619924.384630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619924.384888:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017088 00000100:00100000:1.0:1788619924.384897:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017088 00000100:00100000:1.0:1788619924.384979:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788619924.384991:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657017088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619924.385061:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657017088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619924.385069:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00080000:3.0:1788619924.385513:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788619924.386387:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657016960 00000100:00100000:0.0:1788619924.386398:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657016960 00000100:00100000:0.0:1788619924.386569:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017216 00000100:00100000:0.0:1788619924.386574:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017216 00000100:00100000:1.0:1788619924.386645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:1.0:1788619924.386657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657016960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619924.386728:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657016960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619924.386736:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00080000:3.0:1788619924.388369:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619924.388550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1788619924.388575:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657017216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619924.388674:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657017216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 104us (7481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.388681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788619924.679248:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676976000:0@lo:400:kworker.0 00000100:00100000:2.0:1788619924.679313:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619924.679372:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619924.679379:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676976128:0@lo:400:kworker.0 00000100:00100000:2.0:1788619924.679406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619924.679442:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976000 00000100:00100000:2.0:1788619924.679449:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976000 00000100:00100000:2.0:1788619924.679503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788619924.679512:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676976000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619924.679576:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676976000:12345-0@lo:400:kworker.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619924.679599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788619924.679623:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619924.679651:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676976000:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.679729:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676975872:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.679758:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619924.679804:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676976384:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.679826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619924.679852:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788619924.679858:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676975744:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.679885:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619924.679905:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676976256:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.679925:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619924.679955:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976128 00000100:00100000:0.0:1788619924.679959:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976128 00000100:00100000:0.0:1788619924.679994:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976384 00000100:00100000:0.0:1788619924.679997:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976384 00000100:00100000:0.0:1788619924.680019:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788619924.680026:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676976128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680063:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676976128:12345-0@lo:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.680069:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788619924.680083:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619924.680089:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676976384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680122:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676976384:12345-0@lo:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.680138:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619924.680156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975744 00000100:00100000:0.0:1788619924.680161:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975744 00000100:00100000:0.0:1788619924.680184:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788619924.680190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676975744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676975744:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.680226:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788619924.680253:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676975872 00000100:00100000:0.0:1788619924.680257:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676975872 00000100:00100000:0.0:1788619924.680275:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976256 00000100:00100000:0.0:1788619924.680278:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976256 00000100:00100000:0.0:1788619924.680294:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788619924.680299:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676975872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680326:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676975872:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.680332:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788619924.680343:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788619924.680348:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676976256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680374:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676976256:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619924.680380:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788619924.680393:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788619924.680396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788619924.680398:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619924.680421:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676975744:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680461:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676976256:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680471:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676975872:0@lo:400:kworker.0 00000100:00100000:0.0:1788619924.680479:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788619924.680484:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93338715d500, transno 4294967300 00000100:00100000:0.0:1788619924.680495:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676976384:0@lo:400:kworker.0 00010000:00080000:0.0:1788619924.680872:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333908a4000 x1875503676976128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619924.680883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676976128:0@lo:400:kworker.0 00010000:00010000:1.0:1788619924.935236:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619925.191289:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788619925.191313:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333b94fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676976512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619925.191381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619925.191610:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976512 00000100:00100000:3.0:1788619925.191619:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976512 00000100:00100000:3.0:1788619925.191670:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788619925.191680:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676976512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788619925.191731:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619925.191820:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676976512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619925.191827:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788619925.191955:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333b94fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676976512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619925.703285:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619925.703353:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676976640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619925.703422:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619925.703634:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976640 00000100:00100000:3.0:1788619925.703643:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976640 00000100:00100000:3.0:1788619925.703693:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788619925.703703:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676976640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619925.703738:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619925.703820:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676976640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619925.703828:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788619925.703955:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386710380 x1875503676976640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619925.703973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676976640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619925.959035:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619926.983134:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619928.007934:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619929.030996:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619929.499631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619929.499673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619929.499709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619929.499748:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619929.499815:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017600 00000100:00100000:1.0:1788619929.499825:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017600 00000100:00100000:1.0:1788619929.499883:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788619929.499892:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657017600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619929.499978:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657017600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619929.499986:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:1.0:1788619929.500007:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619929.500448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017344 00000100:00100000:3.0:1788619929.500454:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017344 00000100:00100000:3.0:1788619929.500497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:3.0:1788619929.500506:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2357:x1875503657017344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619929.500545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2357:x1875503657017344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619929.500551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:2.0:1788619929.501386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017472 00000100:00100000:2.0:1788619929.501394:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017472 00000100:00100000:2.0:1788619929.501459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017728 00000100:00100000:2.0:1788619929.501463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017728 00000100:00100000:2.0:1788619929.501487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788619929.501494:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657017472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619929.501538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657017472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619929.501546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788619929.501560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1788619929.501566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657017728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619929.501588:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2357:x1875503657017728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619929.501594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00080000:3.0:1788619929.503862:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619929.800600:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676977024:0@lo:400:kworker.0 00000100:00100000:2.0:1788619929.800688:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619929.800737:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788619929.800743:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676977152:0@lo:400:kworker.0 00000100:00100000:2.0:1788619929.800767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619929.800897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977024 00000100:00100000:2.0:1788619929.800903:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977024 00000100:00100000:2.0:1788619929.800962:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788619929.800971:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676977024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801092:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676976768:0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619929.801148:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676977280:0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801169:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619929.801187:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788619929.801192:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676976896:0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801212:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619929.801226:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676977408:0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619929.801278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977280 00000100:00100000:1.0:1788619929.801282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977280 00000100:00100000:1.0:1788619929.801301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976896 00000100:00100000:1.0:1788619929.801310:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976896 00000100:00100000:1.0:1788619929.801326:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788619929.801332:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676977280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801369:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676977280:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619929.801376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788619929.801391:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788619929.801396:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676976896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801435:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676976896:12345-0@lo:400:kworker.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619929.801441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788619929.801457:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619929.801483:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676976896:0@lo:400:kworker.0 00000100:00100000:1.0:1788619929.801493:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676977280:0@lo:400:kworker.0 00000100:00100000:3.0:1788619929.801581:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977152 00000100:00100000:3.0:1788619929.801591:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977152 00000100:00100000:3.0:1788619929.801630:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977408 00000100:00100000:3.0:1788619929.801633:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977408 00000100:00100000:3.0:1788619929.801657:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788619929.801663:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619929.801703:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676977152:12345-0@lo:400:kworker.0 Request processed in 40us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619929.801708:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788619929.801720:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788619929.801726:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676977408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619929.801757:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676977408:12345-0@lo:400:kworker.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619929.801763:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788619929.801817:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333908a7100 x1875503676977152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619929.801827:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676977152:0@lo:400:kworker.0 00000100:00100000:3.0:1788619929.801853:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676977408:0@lo:400:kworker.0 00000100:00080000:1.0:1788619929.802197:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619929.802201:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619929.802413:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676976768 00000100:00100000:0.0:1788619929.802418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676976768 00000100:00100000:0.0:1788619929.802456:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788619929.802463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676976768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619929.802509:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676976768:12345-0@lo:400:kworker.0 Request processed in 46us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619929.802515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788619929.802557:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676976768:0@lo:400:kworker.0 00000100:00100000:2.0:1788619929.803340:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676977024:12345-0@lo:400:kworker.0 Request processed in 2367us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619929.803349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788619929.803644:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676977024:0@lo:400:kworker.0 00010000:00010000:0.0:1788619930.055049:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619930.311111:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619930.311133:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676977536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619930.311207:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619930.314923:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977536 00000100:00100000:2.0:1788619930.317066:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977536 00000100:00100000:2.0:1788619930.317152:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788619930.317162:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676977536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619930.317203:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619930.317307:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676977536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (6099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619930.317314:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788619930.317549:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676977536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619930.825764:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676977664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619930.825997:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619930.826113:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977664 00000100:00100000:2.0:1788619930.826122:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977664 00000100:00100000:2.0:1788619930.826177:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788619930.826203:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676977664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619930.826239:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619930.828491:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676977664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2296us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619930.828514:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788619930.828687:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386712300 x1875503676977664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619930.828712:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676977664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788619931.079087:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788619931.338427:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788619932.107633:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619933.127084:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619934.152885:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619934.621314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619934.621377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619934.621525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017856 00000100:00100000:0.0:1788619934.621535:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017856 00000100:00100000:0.0:1788619934.621588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:0.0:1788619934.621598:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657017856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619934.621670:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657017856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619934.621677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:2.0:1788619934.622074:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657017984 00000100:00100000:2.0:1788619934.622079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657017984 00000100:00100000:2.0:1788619934.622128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1788619934.622135:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657017984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619934.622171:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657017984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619934.622178:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00080000:3.0:1788619934.622290:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619934.639576:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619934.639741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619934.640423:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018240 00000100:00100000:0.0:1788619934.640434:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018240 00000100:00100000:0.0:1788619934.640535:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1788619934.640545:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657018240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619934.640622:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657018240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619934.640629:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00080000:1.0:1788619934.641061:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619934.643118:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018112 00000100:00100000:3.0:1788619934.643130:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018112 00000100:00100000:3.0:1788619934.643314:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788619934.643327:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2353:x1875503657018112:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788619934.643354:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe257 00000100:00080000:3.0:1788619934.643386:0:6691:0:(import.c:65:import_set_state_nolock()) ffff933284da6800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788619934.643389:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788619934.643430:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788619934.643509:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619934.644055:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+2:2353:x1875503657018112:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 730us (4486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619934.644064:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788619934.919115:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676978048:0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.919190:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619934.919244:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619934.919250:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978176:0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.919271:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619934.919303:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978176 00000100:00100000:1.0:1788619934.919310:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978176 00000100:00100000:1.0:1788619934.919358:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788619934.919380:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.919447:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978176:12345-0@lo:400:kworker.0 Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619934.919454:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788619934.919488:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788619934.919514:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd22f480 x1875503676978176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619934.919528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978176:0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919600:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676977920:0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919638:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619934.919658:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676978432:0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619934.919694:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788619934.919699:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676977792:0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919719:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619934.919736:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676978304:0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919753:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619934.919791:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977792 00000100:00100000:3.0:1788619934.919794:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977792 00000100:00100000:3.0:1788619934.919817:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788619934.919823:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676977792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619934.919853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676977792:12345-0@lo:400:kworker.0 Request processed in 30us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619934.919858:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788619934.919884:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676977792:0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920092:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978048 00000100:00100000:1.0:1788619934.920096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978048 00000100:00100000:1.0:1788619934.920130:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676977920 00000100:00100000:1.0:1788619934.920133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676977920 00000100:00100000:1.0:1788619934.920142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978304 00000100:00100000:1.0:1788619934.920155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978304 00000100:00100000:1.0:1788619934.920170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788619934.920175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920209:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676978048:12345-0@lo:400:kworker.0 Request processed in 34us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619934.920215:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788619934.920224:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788619934.920229:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676977920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920253:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676977920:12345-0@lo:400:kworker.0 Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619934.920259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788619934.920267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788619934.920272:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676978304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920291:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676978304:12345-0@lo:400:kworker.0 Request processed in 20us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619934.920296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788619934.920316:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676978304:0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920324:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676977920:0@lo:400:kworker.0 00000100:00100000:1.0:1788619934.920347:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676978048:0@lo:400:kworker.0 00000100:00080000:3.0:1788619934.920843:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619934.922058:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978432 00000100:00100000:0.0:1788619934.922068:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978432 00000100:00100000:0.0:1788619934.922135:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788619934.922144:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676978432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619934.922228:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676978432:12345-0@lo:400:kworker.0 Request processed in 86us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619934.922235:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788619934.922274:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676978432:0@lo:400:kworker.0 00000100:00080000:3.0:1788619934.922489:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788619935.174976:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619935.431805:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619935.431877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619935.432097:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978560 00000100:00100000:0.0:1788619935.432104:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978560 00000100:00100000:0.0:1788619935.432165:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788619935.432175:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619935.432232:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619935.432282:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619935.432289:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788619935.432474:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619935.944965:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619935.944991:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619935.945061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619935.945240:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978688 00000100:00100000:3.0:1788619935.945249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978688 00000100:00100000:3.0:1788619935.945320:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788619935.945329:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619935.945378:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619935.945431:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676978688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (369us total) trans 0 rc 0/0 00010000:00080000:0.0:1788619935.945466:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386712680 x1875503676978688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619935.945487:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676978688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619935.946138:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:1.0:1788619936.199110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619937.225383:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619938.249182:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788619938.551329:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:1.0:1788619938.551359:0:7647:0:(genops.c:885:class_export_put()) final put ffff9333c1e06800/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:0.0:1788619938.551588:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333c1e06800/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-OST0001 00000020:00000080:0.0:1788619938.551723:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284da6800 for lustre-OST0001 00010000:00010000:2.0:1788619939.271760:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619939.739228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619939.739322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619939.739368:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619939.739537:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018624 00000100:00100000:3.0:1788619939.739548:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018624 00000100:00100000:3.0:1788619939.739629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018496 00000100:00100000:3.0:1788619939.739633:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018496 00000100:00100000:3.0:1788619939.739662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788619939.739672:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657018624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619939.739689:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:2.0:1788619939.739702:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657018496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619939.739764:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657018496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (394us total) trans 0 rc 0/0 00000100:00080000:1.0:1788619939.739767:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619939.739805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1788619939.741700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018368 00000100:00100000:0.0:1788619939.741713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018368 00000100:00100000:0.0:1788619939.741790:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:0.0:1788619939.741801:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657018368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619939.742940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657018624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3264us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619939.742952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1788619939.743452:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657018368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1650us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619939.743613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:3.0:1788619940.040721:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676978944:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.040808:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.040853:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676979456:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.040877:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.040905:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788619940.040911:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676978816:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.040938:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.040958:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676979328:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.040979:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.041002:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676979072:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.041565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.041596:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619940.041603:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979200:0@lo:400:kworker.0 00000100:00100000:1.0:1788619940.041720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978944 00000100:00100000:1.0:1788619940.041729:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978944 00000100:00100000:1.0:1788619940.041766:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979328 00000100:00100000:1.0:1788619940.041769:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979328 00000100:00100000:1.0:1788619940.041806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979072 00000100:00100000:1.0:1788619940.041809:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979072 00000100:00100000:1.0:1788619940.041824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788619940.041831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676978944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619940.041883:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676978944:12345-0@lo:400:kworker.0 Request processed in 52us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619940.041889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788619940.041904:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788619940.041909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619940.041934:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676979328:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619940.041940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788619940.041950:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788619940.041955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676979072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619940.041979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676979072:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619940.041985:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788619940.042003:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619940.042553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619940.042593:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676979072:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.042758:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979456 00000100:00100000:3.0:1788619940.042763:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979456 00000100:00100000:3.0:1788619940.042873:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979200 00000100:00100000:3.0:1788619940.042877:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979200 00000100:00100000:3.0:1788619940.042899:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788619940.042906:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676979456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.042942:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676979456:12345-0@lo:400:kworker.0 Request processed in 37us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619940.042948:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788619940.042960:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788619940.042966:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.042997:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979200:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619940.043002:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788619940.044127:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619940.044134:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619940.044197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676978816 00000100:00100000:3.0:1788619940.044204:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676978816 00000100:00100000:3.0:1788619940.044288:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788619940.044297:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676978816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.044374:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333875afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676978816:12345-0@lo:400:kworker.0 Request processed in 78us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619940.044381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788619940.056837:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676978816:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.056867:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676979328:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.056879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676978944:0@lo:400:kworker.0 00000100:00100000:3.0:1788619940.056891:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676979456:0@lo:400:kworker.0 00010000:00080000:3.0:1788619940.056969:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933386710000 x1875503676979200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788619940.056981:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979200:0@lo:400:kworker.0 00010000:00010000:0.0:1788619940.304282:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619940.554133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619940.554203:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619940.555989:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979584 00000100:00100000:0.0:1788619940.556000:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979584 00000100:00100000:0.0:1788619940.556724:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788619940.556737:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619940.557352:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619940.557434:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 700us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619940.557441:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788619940.557530:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619941.063375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788619941.063399:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619941.063470:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619941.063592:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979712 00000100:00100000:3.0:1788619941.063600:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979712 00000100:00100000:3.0:1788619941.063651:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788619941.063660:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619941.063695:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619941.063746:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676979712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619941.063754:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788619941.064026:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bd23ad80 x1875503676979712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788619957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619941.064045:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676979712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619941.320738:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788619941.576962:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788619941.868255:0:11861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:52:21 (1788619941) 00010000:00010000:2.0:1788619942.342996:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619943.366991:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619943.574841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619943.575002:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018752 00000100:00100000:1.0:1788619943.575012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018752 00000100:00100000:1.0:1788619943.575130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788619943.575142:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:10256:x1875503657018752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619943.575161:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619943.575219:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8d0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575301:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575323:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575337:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619943.575733:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788619943.575738:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619943.575814:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575841:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d0 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575858:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d0 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.575885:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:1.0:1788619943.575888:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788619943.575891:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fa00, rc 0) 00000100:00100000:1.0:1788619943.575954:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:10256:x1875503657018752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 815us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619943.575961:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00080000:2.0:1788619943.576600:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619943.587731:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619943.588322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657018880 00000100:00100000:3.0:1788619943.588333:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657018880 00000100:00100000:3.0:1788619943.588651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788619943.588663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:10257:x1875503657018880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619943.588685:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619943.588717:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588883:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588898:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588909:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588928:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.588934:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589143:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589152:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589160:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619943.589186:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788619943.589189:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619943.589207:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589224:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589230:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589237:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589242:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619943.589246:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589253:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589268:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:3.0:1788619943.589270:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619943.589275:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589290:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589296:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589301:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589322:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619943.589325:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589331:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff933388291800) 00010000:00010000:3.0:1788619943.589347:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619943.589350:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589355:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe33e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589394:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d7 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589952:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d7 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619943.589965:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933388291c00) 00010000:00010000:3.0:1788619943.589968:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619943.589970:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf600, rc 0) 00000100:00100000:3.0:1788619943.590039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:10257:x1875503657018880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1378us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619943.590047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788619943.597231:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619943.597354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019136 00000100:00100000:1.0:1788619943.597368:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019136 00000100:00100000:1.0:1788619943.597441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1788619943.597461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:10257:x1875503657019136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619943.597489:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619943.597516:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe34c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.597612:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.597631:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.597645:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599111:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599137:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599165:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599557:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe361 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599637:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe361 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599645:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe361 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619943.599767:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788619943.599924:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599932:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599939:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599945:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619943.599949:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599957:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599969:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933388291c00) 00010000:00010000:1.0:1788619943.599973:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619943.599984:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.599991:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe353 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600003:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600009:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600015:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600020:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619943.600023:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600029:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600035:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff933390117900) 00010000:00010000:1.0:1788619943.600038:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619943.600040:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600046:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe35a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600503:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe34c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8de expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600532:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe361 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8de expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619943.600540:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:1.0:1788619943.600542:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619943.600544:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18ee00, rc 0) 00000100:00100000:1.0:1788619943.600896:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:10257:x1875503657019136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3443us (3679us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788619943.600905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788619943.607859:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619943.608200:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019264 00000100:00100000:1.0:1788619943.608214:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019264 00000100:00100000:1.0:1788619943.608294:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788619943.608314:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:10257:x1875503657019264:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788619943.608435:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:10257:x1875503657019264:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 132us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619943.608442:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000040:00080000:2.0:1788619943.623725:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788619943.704295:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1788619944.392520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619944.873224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619944.873260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619944.873290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619944.873332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019392 00000100:00100000:0.0:1788619944.873342:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019392 00000100:00100000:0.0:1788619944.873390:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:0.0:1788619944.873400:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657019392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619944.873478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657019392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619944.873486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:0.0:1788619944.873518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019648 00000100:00100000:0.0:1788619944.873522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019648 00000100:00100000:0.0:1788619944.873558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019520 00000100:00100000:0.0:1788619944.873561:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019520 00000100:00100000:0.0:1788619944.873592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788619944.873598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657019648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619944.873631:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657019648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619944.873637:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788619944.873649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788619944.873655:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657019520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619944.873680:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657019520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619944.873685:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00080000:0.0:1788619944.873843:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619945.160421:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676980096:0@lo:400:kworker.0 00000100:00100000:1.0:1788619945.160491:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619945.160544:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619945.160549:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676980224:0@lo:400:kworker.0 00000100:00100000:1.0:1788619945.160576:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619945.160611:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676980096 00000100:00100000:1.0:1788619945.160619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676980096 00000100:00100000:1.0:1788619945.160674:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788619945.160698:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676980096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619945.160749:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676980096:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619945.160756:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788619945.160803:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676980224 00000100:00100000:1.0:1788619945.160808:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676980224 00000100:00100000:1.0:1788619945.160917:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788619945.160925:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676980224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619945.160957:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676980224:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619945.160963:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788619945.160980:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619945.160984:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788619945.161016:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bb923480 x1875503676980224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788619961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619945.161030:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676980224:0@lo:400:kworker.0 00000100:00100000:1.0:1788619945.161041:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676980096:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161129:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676979968:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161165:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619945.161205:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676980480:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161228:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619945.161256:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788619945.161263:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676979840:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619945.161328:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676980352:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161355:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619945.161383:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676980480 00000100:00100000:3.0:1788619945.161387:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676980480 00000100:00100000:3.0:1788619945.161424:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788619945.161432:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676980480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161476:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676980480:12345-0@lo:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619945.161483:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788619945.161505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979840 00000100:00100000:3.0:1788619945.161509:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979840 00000100:00100000:3.0:1788619945.161536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788619945.161544:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676979840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676979840:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619945.161579:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788619945.161611:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676979840:0@lo:400:kworker.0 00000100:00100000:3.0:1788619945.161623:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676980480:0@lo:400:kworker.0 00000100:00100000:0.0:1788619945.161990:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676979968 00000100:00100000:0.0:1788619945.161997:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676979968 00000100:00100000:0.0:1788619945.162026:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676980352 00000100:00100000:0.0:1788619945.162030:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676980352 00000100:00100000:0.0:1788619945.162053:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788619945.162060:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676979968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619945.162250:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676979968:12345-0@lo:400:kworker.0 Request processed in 190us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619945.162260:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788619945.162279:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788619945.162287:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676980352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619945.162328:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676980352:12345-0@lo:400:kworker.0 Request processed in 43us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619945.162334:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788619945.162374:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676980352:0@lo:400:kworker.0 00000100:00100000:0.0:1788619945.162405:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676979968:0@lo:400:kworker.0 00000100:00080000:1.0:1788619945.162524:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788619945.162529:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788619945.415057:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619945.639416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.640603:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657019776 00000100:00100000:1.0:1788619945.640614:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657019776 00000100:00100000:1.0:1788619945.640697:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788619945.640708:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:10300:x1875503657019776:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619945.640728:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619945.640747:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe36f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8e5 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788619945.640813:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788619945.640847:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.640863:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.640876:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.640891:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.640898:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.640905:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641080:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641089:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641095:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641101:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619945.641106:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641123:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641135:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:1.0:1788619945.641138:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.641142:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641149:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641159:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641165:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641171:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641176:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fc00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619945.641179:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641184:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641190:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933390117900) 00010000:00010000:1.0:1788619945.641192:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.641195:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641208:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe37d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641236:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe36f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8e5 expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641245:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:1.0:1788619945.641247:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.641251:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe36f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8e5 expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.641259:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18f600, rc 0) 00000100:00100000:1.0:1788619945.641326:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:10300:x1875503657019776:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 620us (1921us total) trans 0 rc 301/301 00000100:00100000:1.0:1788619945.641333:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788619945.650988:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619945.651173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020032 00000100:00100000:3.0:1788619945.651190:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020032 00000100:00100000:3.0:1788619945.651247:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788619945.651259:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:10300:x1875503657020032:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1788619945.651327:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619945.651355:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d0 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651373:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:3.0:1788619945.651385:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619945.651589:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651604:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651614:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651627:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651634:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.651642:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619945.656065:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788619945.656082:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656093:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656107:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656113:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619945.656117:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656125:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656141:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933388291800) 00010000:00010000:3.0:1788619945.656145:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619945.656151:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.656157:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe384 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619945.656178:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de0d583c reply state 0000000078925fc2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619945.656186:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619945.656314:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:10300:x1875503657020032:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 5054us (5329us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788619945.656324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:3.0:1788619945.660156:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660174:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660192:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660198:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619945.660203:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660211:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660227:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933388291900) 00010000:00010000:3.0:1788619945.660230:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619945.660235:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.660242:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe38b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619945.671937:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788619945.671960:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676980608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619945.672028:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619945.672876:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676980608 00000100:00100000:3.0:1788619945.672884:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676980608 00000100:00100000:3.0:1788619945.672935:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788619945.672945:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676980608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788619945.672980:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619945.673042:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676980608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619945.673049:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788619945.673165:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676980608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619945.768050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.768275:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020160 00000100:00100000:1.0:1788619945.768285:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020160 00000100:00100000:1.0:1788619945.768353:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788619945.768364:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:10308:x1875503657020160:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:1.0:1788619945.768387:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619945.768411:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8ec expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768480:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768494:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768521:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619945.768559:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788619945.768564:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619945.768601:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768637:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8ec expref: 10 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768654:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8ec expref: 9 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.768663:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619945.768667:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788619945.768670:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fc00, rc 0) 00000100:00100000:1.0:1788619945.768732:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:10308:x1875503657020160:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 371us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619945.768739:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788619945.904711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.904833:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020288 00000100:00100000:1.0:1788619945.904845:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020288 00000100:00100000:1.0:1788619945.904910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788619945.904922:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+9:10314:x1875503657020288:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788619945.904946:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619945.904967:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe3a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8f3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905056:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905071:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905084:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905099:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905106:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905113:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905212:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905220:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905227:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619945.905253:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788619945.905257:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619945.905317:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905341:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905347:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905354:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905360:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619945.905365:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905372:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619945.905388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.905393:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905399:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbe3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905411:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905417:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905423:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905435:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619945.905438:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905460:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905468:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933390117500) 00010000:00010000:1.0:1788619945.905471:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.905474:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905479:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbe3ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905511:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbe3a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8f3 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905525:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8f3 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.905532:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:1.0:1788619945.905535:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788619945.905537:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18e200, rc 0) 00000100:00100000:1.0:1788619945.905595:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+10:10314:x1875503657020288:12345-192.168.203.12@tcp:101:bash.0 Request processed in 675us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619945.905602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788619945.910153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.910231:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020544 00000100:00100000:1.0:1788619945.910255:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020544 00000100:00100000:1.0:1788619945.910324:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788619945.910335:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+10:10314:x1875503657020544:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788619945.910358:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619945.910395:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe3bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a8fa expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911031:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911048:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911059:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911101:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911110:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.911117:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619945.915868:0:8707:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788619945.916328:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916345:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916357:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916393:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916400:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916406:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916412:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619945.916426:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916434:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916447:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619945.916451:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619945.916455:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916463:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe3c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619945.916475:0:8707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c4f05d3 reply state 0000000072342f16 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619945.916489:0:8707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788619945.916531:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe3bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 13 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916547:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 12 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.916554:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619945.916556:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619945.916559:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2600, rc 0) 00000100:00100000:0.0:1788619945.916708:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+13:10314:x1875503657020544:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6373us (6562us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788619945.916717:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788619945.921885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1788619945.921962:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.921986:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.921995:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.922019:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619945.922024:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.922032:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.922049:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933390117500) 00010000:00010000:1.0:1788619945.922052:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619945.922056:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.922063:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbe3ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619945.922374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020672 00000100:00100000:3.0:1788619945.922386:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020672 00000100:00100000:3.0:1788619945.922433:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788619945.922450:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875503657020672:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:3.0:1788619945.922480:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:3.0:1788619945.922514:0:6692:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe3df 00002000:00100000:3.0:1788619945.922525:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11f76a03-c7c3-4513-8603-309aac0577a7/ffff9333a53c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788619945.922549:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788619945.923463:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788619945.923500:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9333a53c7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788619945.924123:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503657020672:12345-192.168.203.12@tcp:8:bash.0 Request processed in 1671us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619945.924133:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788619945.941029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619945.941280:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020800 00000100:00100000:3.0:1788619945.941303:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020800 00000100:00100000:3.0:1788619945.941373:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788619945.941383:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:0:x1875503657020800:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619945.941400:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619945.941422:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a901 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619945.941448:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788619945.941467:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1788619945.941471:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619945.941481:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.941502:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619945.941531:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfe00, rc 0) 00000100:00100000:3.0:1788619945.941594:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:0:x1875503657020800:12345-192.168.203.12@tcp:101:bash.0 Request processed in 212us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619945.941601:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00080000:0.0:1788619945.942130:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619945.946736:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.946901:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657020928 00000100:00100000:1.0:1788619945.946911:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657020928 00000100:00100000:1.0:1788619945.946970:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788619945.946992:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:10314:x1875503657020928:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788619945.947010:0:8933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619945.947030:0:8933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a908 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.947062:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.947072:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619945.947083:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619945.947101:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.947138:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.947153:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 8 pid: 6689 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619945.947167:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8933:1875503676980736:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619945.947258:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788619945.955566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619945.959664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657021056 00000100:00100000:0.0:1788619945.959680:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657021056 00010000:00010000:0.0:1788619945.959732:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 9 pid: 6689 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619945.959830:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788619945.959841:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657021056:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619945.959854:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619945.959878:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 9 pid: 6689 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.959893:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 9 pid: 6689 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.959918:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619945.959922:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619945.959932:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.959942:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619945.959993:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619945.960028:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875503676980864:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788619945.960117:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619945.963099:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875503676980864:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788619945.963127:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619945.963186:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657021056:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 3345us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619945.963198:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00010000:00010000:1.0:1788619945.964746:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbe3e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a901 expref: 8 pid: 6689 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619945.964768:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8933:1875503676980736:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619945.964835:0:8933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619945.964850:0:8933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142400, rc 0) 00000100:00100000:1.0:1788619945.964899:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:10314:x1875503657020928:12345-192.168.203.12@tcp:101:bash.0 Request processed in 17920us (18172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619945.964908:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788619945.972850:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619945.972932:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657021312 00000100:00100000:1.0:1788619945.972941:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657021312 00000100:00100000:1.0:1788619945.972996:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788619945.973020:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+12:10314:x1875503657021312:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788619945.973365:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:10314:x1875503657021312:12345-192.168.203.12@tcp:35:bash.0 Request processed in 347us (524us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788619945.973373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788619946.059895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.060020:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657021568 00000100:00100000:1.0:1788619946.060047:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657021568 00000100:00100000:1.0:1788619946.060592:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788619946.060603:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+13:10324:x1875503657021568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619946.060633:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619946.060675:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbe3f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a90f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619946.060822:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788619946.060982:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbe3f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a90f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.061011:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619946.061015:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788619946.061022:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbe3f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a90f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.061046:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143e00, rc 0) 00000100:00100000:1.0:1788619946.061305:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:10324:x1875503657021568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 701us (1546us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788619946.061313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1788619946.066117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.066203:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657021824 00000100:00100000:1.0:1788619946.066235:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657021824 00000100:00100000:1.0:1788619946.066316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788619946.066328:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:10324:x1875503657021824:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788619946.066648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:10324:x1875503657021824:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 322us (546us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788619946.066655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788619946.137335:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.137448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657021952 00000100:00100000:3.0:1788619946.137463:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657021952 00000100:00100000:3.0:1788619946.137538:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788619946.137549:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+15:10330:x1875503657021952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619946.137582:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619946.137609:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a916 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.137700:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.138106:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.138128:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619946.138173:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788619946.138176:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619946.138198:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.138231:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a916 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.138281:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a916 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.138302:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:3.0:1788619946.138306:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619946.138309:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:3.0:1788619946.138428:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:10330:x1875503657021952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 880us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619946.138437:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788619946.142767:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.142962:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022208 00000100:00100000:3.0:1788619946.142975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022208 00000100:00100000:3.0:1788619946.143041:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788619946.143053:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:10330:x1875503657022208:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619946.143079:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619946.143106:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe410 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a91d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.143232:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.143251:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.143264:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619946.143278:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788619946.143479:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe410 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a91d expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.143503:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a91d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.143513:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788619946.143516:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619946.143521:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfe00, rc 0) 00000100:00100000:3.0:1788619946.143594:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+18:10330:x1875503657022208:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 543us (842us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788619946.143602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788619946.147157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.148466:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022464 00000100:00100000:2.0:1788619946.148485:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022464 00000100:00100000:0.0:1788619946.148515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.148568:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788619946.148582:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:10330:x1875503657022464:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619946.148618:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788619946.148626:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022592 00000100:00100000:1.0:1788619946.148645:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022592 00010000:00010000:2.0:1788619946.148649:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a924 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.148814:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.148834:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.148845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00010000:00010000:2.0:1788619946.148851:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619946.148873:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788619946.148883:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:2354:x1875503657022592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619946.148948:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619946.148986:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a91d expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.149013:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:1.0:1788619946.149019:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619946.149097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+21:2354:x1875503657022592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 230us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619946.149105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00010000:00010000:2.0:1788619946.149187:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a924 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.149210:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a924 expref: 19 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.149232:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:2.0:1788619946.149236:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788619946.149240:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:2.0:1788619946.149306:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:10330:x1875503657022464:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 726us (2164us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788619946.149315:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788619946.154949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.155232:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022720 00000100:00100000:3.0:1788619946.155246:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022720 00000100:00100000:3.0:1788619946.155326:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788619946.155339:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2357:x1875503657022720:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1788619946.155397:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.155423:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.155486:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788619946.155493:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619946.155499:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.155550:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.155584:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 7 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619946.155602:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd238000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676980992:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619946.155767:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc58d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788619946.159277:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.159396:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022848 00000100:00100000:1.0:1788619946.159409:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022848 00002000:00100000:1.0:1788619946.159536:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9333bcb95c00 x1875503657022848/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:42/0 lens 504/0 e 0 to 0 dl 1788619957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788619946.159549:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bcb95c00 with x1875503657022848 ext(0->12) 00010000:00010000:1.0:1788619946.159561:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 8 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.159604:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 8 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788619946.159614:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bcb95c00 00000100:00100000:1.0:1788619946.159658:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788619946.159670:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657022848:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788619946.159865:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd238000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676980992:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619946.159898:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.183720:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619946.183899:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676981120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619946.183995:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619946.184056:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676981120 00000100:00100000:1.0:1788619946.184067:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676981120 00000100:00100000:1.0:1788619946.184192:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788619946.184203:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676981120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788619946.184235:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788619946.184296:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676981120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619946.184305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788619946.184368:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676981120:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788619946.210108:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000100:00100000:0.0:1788619946.213061:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657022848:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 53379us (53785us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788619946.213085:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:0.0:1788619946.213299:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9333bcb95c00 x1875503657022848/t4294967299(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:42/0 lens 504/448 e 0 to 0 dl 1788619957 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788619946.213312:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bcb95c00 with x1875503657022848 ext(0->12) 00010000:00010000:0.0:1788619946.213326:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.213350:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788619946.213360:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bcb95c00 00000100:00100000:0.0:1788619946.217419:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.223198:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657022976 00000100:00100000:2.0:1788619946.223214:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657022976 00010000:00010000:2.0:1788619946.223266:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619946.223564:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788619946.223576:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657022976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619946.223592:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788619946.223611:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788619946.223614:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788619946 00002000:00010000:2.0:1788619946.223616:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788619946 00002000:00010000:2.0:1788619946.223618:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788619946 00010000:00010000:2.0:1788619946.223624:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.223638:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.223687:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbe3ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a908 expref: 9 pid: 8933 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.223704:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619946.223708:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619946.223713:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.223734:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.223762:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619946.223900:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657022976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 326us (6491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619946.223908:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:3.0:1788619946.223990:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224003:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224030:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224039:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224046:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224064:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788619946.224069:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224079:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224091:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.224099:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619946.224149:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2357:x1875503657022720:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 68812us (69214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619946.224157:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788619946.229810:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.233870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657023232 00000100:00100000:1.0:1788619946.233885:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657023232 00000100:00100000:1.0:1788619946.233994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788619946.234006:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+19:10330:x1875503657023232:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:1.0:1788619946.234069:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a924 expref: 19 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619946.234411:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788619946.235019:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788619946.237104:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788619946.239467:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.239502:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 23 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.239512:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.240441:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 23 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.241406:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 23 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.241423:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676981248:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619946.241611:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333850a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619946.245362:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676981248:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619946.245396:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619946.249172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619946.251484:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657023360 00000100:00100000:0.0:1788619946.251498:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657023360 00010000:00010000:0.0:1788619946.251547:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 24 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619946.252718:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788619946.252736:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+24:2354:x1875503657023360:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619946.252753:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619946.252762:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 24 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252802:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 24 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252826:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbe3d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8fa expref: 24 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252842:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619946.252848:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252856:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252864:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.252888:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619946.252971:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+23:2354:x1875503657023360:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 242us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619946.252980:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:2.0:1788619946.253052:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.253060:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788619946.253195:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788619946.253403:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788619946.253514:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd244a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676981376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788619946.253613:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619946.253649:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788619946.254324:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676981376 00000100:00100000:1.0:1788619946.254333:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676981376 00000100:00100000:1.0:1788619946.254418:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788619946.254428:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676981376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788619946.254524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676981376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619946.254534:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788619946.254599:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd244a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676981376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619946.256339:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788619946.256433:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676981504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788619946.256692:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619946.256725:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788619946.256760:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676981504 00000100:00100000:2.0:1788619946.256767:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676981504 00000100:00100000:2.0:1788619946.256886:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788619946.256897:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676981504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788619946.257099:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875503676981504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 203us (406us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788619946.257108:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788619946.257180:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676981504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619946.257298:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788619946.257344:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257354:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257362:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257369:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619946.257373:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257381:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257395:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619946.257398:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788619946.257403:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.257409:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe441 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619946.257736:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788619946.258175:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788619946.258187:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349226414377ns, next at 350226412027ns, rc = 0 00000001:00080000:0.0:1788619946.258195:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788619946.258231:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619946.258296:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788619946.258305:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe42c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a924 expref: 27 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619946.258403:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:10330:x1875503657023232:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 24398us (28600us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788619946.258414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000020:00080000:0.0:1788619946.258418:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788619946.269409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.274364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657023488 00000100:00100000:3.0:1788619946.274380:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657023488 00000100:00100000:2.0:1788619946.274892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788619946.274904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:10330:x1875503657023488:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619946.274927:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619946.274956:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a92b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.275017:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe448 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a92b expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.275033:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe448 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a92b expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.275052:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619946.275069:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788619946.275073:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:2.0:1788619946.276349:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+27:10330:x1875503657023488:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1438us (6939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619946.276359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788619946.285732:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.285853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657023744 00000100:00100000:3.0:1788619946.285863:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657023744 00000100:00100000:3.0:1788619946.285919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788619946.285930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933385923050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:10330:x1875503657023744:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788619946.286159:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933385923050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+28:10330:x1875503657023744:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 231us (435us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788619946.286181:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788619946.380508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.380640:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657024000 00000100:00100000:3.0:1788619946.380862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657024000 00000100:00100000:3.0:1788619946.380981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788619946.380995:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+28:10340:x1875503657024000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619946.381028:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619946.381057:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a932 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619946.381171:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788619946.381419:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe44f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a932 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.381440:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:3.0:1788619946.381444:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619946.381452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a932 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.381470:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31400, rc 0) 00000100:00100000:3.0:1788619946.381616:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+29:10340:x1875503657024000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 623us (1121us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788619946.381625:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1788619946.394460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.395654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657024128 00000100:00100000:1.0:1788619946.395670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657024128 00000100:00100000:1.0:1788619946.396052:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788619946.396064:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+29:10340:x1875503657024128:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788619946.396172:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396194:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396208:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396237:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396244:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396251:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396379:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396388:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396396:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619946.396451:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396488:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396496:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396504:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396510:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619946.396516:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396524:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396539:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:1.0:1788619946.396542:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619946.396549:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396555:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe45d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396571:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396577:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396582:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396595:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619946.396598:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396604:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396613:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933390117400) 00010000:00010000:1.0:1788619946.396616:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619946.396619:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396625:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396642:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396648:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396654:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396659:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619946.396662:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396668:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396685:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:1.0:1788619946.396688:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619946.396691:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.396698:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe46b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.397141:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+29:10340:x1875503657024128:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1075us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619946.397152:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788619946.399313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619946.399923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657024384 00000100:00100000:0.0:1788619946.399936:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657024384 00000100:00100000:0.0:1788619946.400471:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788619946.400487:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:10340:x1875503657024384:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619946.401485:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+30:10340:x1875503657024384:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 994us (2177us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788619946.401496:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:2.0:1788619946.442943:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619946.449179:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.449355:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657024640 00000100:00100000:2.0:1788619946.449368:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657024640 00000100:00100000:2.0:1788619946.449445:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788619946.449457:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+30:10343:x1875503657024640:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619946.449487:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619946.449515:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe472 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a939 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449611:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449630:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449644:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449661:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449669:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449701:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449905:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449914:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.449922:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619946.449932:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788619946.450058:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450067:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450074:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450081:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ea000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619946.450086:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450094:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450109:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619946.450113:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619946.450126:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450134:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe479 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450152:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450159:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450165:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450170:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619946.450173:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450179:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450188:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fac00) 00010000:00010000:2.0:1788619946.450190:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619946.450193:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450200:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450252:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450282:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 32 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.450472:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619946.450475:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619946.450478:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eae00, rc 0) 00000100:00100000:2.0:1788619946.450569:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+32:10343:x1875503657024640:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1114us (1405us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788619946.450578:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788619946.463185:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.463317:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657024768 00000100:00100000:2.0:1788619946.463332:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657024768 00000100:00100000:2.0:1788619946.463412:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788619946.463425:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:10343:x1875503657024768:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788619946.463521:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463543:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463557:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463591:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463599:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463628:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463635:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eac00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619946.463641:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463650:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463664:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619946.463668:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619946.463675:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.463681:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619946.465555:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:10343:x1875503657024768:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 2002us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619946.465574:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788619946.467525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.467685:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657025024 00000100:00100000:3.0:1788619946.467697:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657025024 00000100:00100000:3.0:1788619946.467811:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788619946.467943:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+32:10343:x1875503657025024:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788619946.469460:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:10343:x1875503657025024:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 1510us (1935us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788619946.469477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788619946.740589:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.743468:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657025280 00000100:00100000:2.0:1788619946.743490:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657025280 00000100:00100000:2.0:1788619946.743603:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788619946.743615:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+33:10374:x1875503657025280:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788619946.743646:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619946.743675:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe49c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a940 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.744505:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe4a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.744536:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.744551:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619946.744566:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788619946.744937:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe49c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a940 expref: 36 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.744962:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a940 expref: 35 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.744971:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619946.744974:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619946.744978:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb400, rc 0) 00000100:00100000:2.0:1788619946.745075:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+35:10374:x1875503657025280:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1461us (4502us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788619946.745084:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1788619946.753152:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619946.753200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619946.753307:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657025664 00000100:00100000:0.0:1788619946.753321:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657025664 00000100:00100000:0.0:1788619946.753424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788619946.753437:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387304c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:2354:x1875503657025664:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619946.753457:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619946.753505:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a940 expref: 35 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619946.753529:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:0.0:1788619946.753535:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619946.753547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657025536 00000100:00100000:2.0:1788619946.753552:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657025536 00000100:00100000:2.0:1788619946.753584:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788619946.753591:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:10374:x1875503657025536:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788619946.753615:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387304c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:2354:x1875503657025664:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 180us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619946.753622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788619946.753973:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:10374:x1875503657025536:12345-192.168.203.12@tcp:35:cat.0 Request processed in 380us (846us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788619946.753989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788619946.825875:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.826030:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657025920 00000100:00100000:2.0:1788619946.826046:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657025920 00000100:00100000:2.0:1788619946.826129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788619946.826143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+35:10380:x1875503657025920:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788619946.826176:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619946.826180:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788619946.826214:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a916 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826239:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619946.826247:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619946.826265:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a947 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826419:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826436:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 35 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826445:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826494:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 35 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619946.826511:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 35 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619946.826562:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd244700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676981632:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619946.826686:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619946.831440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619946.831569:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd244700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676981632:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619946.831604:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.831705:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657026048 00000100:00100000:1.0:1788619946.831715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657026048 00010000:00010000:1.0:1788619946.831765:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 36 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619946.832297:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788619946.832312:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+36:2354:x1875503657026048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619946.832332:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619946.832340:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 36 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832377:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 36 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832407:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a939 expref: 36 pid: 8707 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832430:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:1.0:1788619946.832436:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832448:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832458:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619946.832497:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619946.832568:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:2354:x1875503657026048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 260us (1142us total) trans 0 rc 0/0 00010000:00010000:3.0:1788619946.832613:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.832621:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619946.832644:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788619946.832920:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.832939:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.832948:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619946.832951:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788619946.832953:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea000, rc 0) 00000100:00100000:3.0:1788619946.832984:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+36:10380:x1875503657025920:12345-192.168.203.12@tcp:101:dd.0 Request processed in 6846us (7124us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788619946.834027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788619946.834637:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1788619946.839183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619946.839369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657026304 00000100:00100000:3.0:1788619946.839388:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657026304 00000100:00100000:3.0:1788619946.839565:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788619946.839579:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:10380:x1875503657026304:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788619946.840025:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.840048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.840062:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788619946.840123:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788619946.840152:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000312fd0e4 reply state 0000000072ef5384 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619946.840162:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619946.840294:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+38:10380:x1875503657026304:12345-192.168.203.12@tcp:36:dd.0 Request processed in 708us (1119us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788619946.840303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000020:00080000:3.0:1788619946.840309:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788619946.847231:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847254:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847262:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847268:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619946.847274:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847294:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847338:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619946.847342:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619946.847348:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619946.847355:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.096015:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619947.096211:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657026432 00000100:00100000:1.0:1788619947.096225:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657026432 00000100:00080000:0.0:1788619947.096316:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619947.096382:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1788619947.096396:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+37:10394:x1875503657026432:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1788619947.096428:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619947.096455:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe4cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a94e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096569:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096587:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096605:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096625:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096633:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096641:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096754:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096766:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096810:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096856:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.096887:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 38 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619947.096905:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676981760:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619947.097035:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333850a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619947.104528:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.104751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657026688 00000100:00100000:2.0:1788619947.104763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657026688 00000100:00100000:2.0:1788619947.104875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788619947.104887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+39:5595:x1875503657026688:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788619947.105362:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+40:5595:x1875503657026688:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 475us (846us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788619947.105373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788619947.105730:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676981760:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619947.105767:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.109009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.109112:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657026816 00000100:00100000:0.0:1788619947.109125:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657026816 00010000:00010000:0.0:1788619947.109180:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 40 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619947.109235:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788619947.109247:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+40:2356:x1875503657026816:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619947.109277:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619947.109295:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 40 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109313:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 40 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109341:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe4b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a947 expref: 40 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109364:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:0.0:1788619947.109388:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109401:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109411:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.109454:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619947.109529:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+39:2356:x1875503657026816:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 284us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619947.109538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00010000:00010000:2.0:1788619947.109674:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109684:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619947.109741:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788619947.109745:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619947.109821:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109849:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109861:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109868:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109876:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109882:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.109887:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109896:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109906:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619947.109909:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.109913:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109919:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe4d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109931:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109937:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109947:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109953:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.109955:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109961:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109968:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933390117400) 00010000:00010000:2.0:1788619947.109970:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.109973:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.109978:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbe4db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.110019:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe4cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a94e expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.110034:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a94e expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.110040:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.110042:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619947.110045:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142800, rc 0) 00000100:00100000:2.0:1788619947.110074:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+38:10394:x1875503657026432:12345-192.168.203.12@tcp:101:stat.0 Request processed in 13684us (14076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.110095:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788619947.195872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.196114:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657027072 00000100:00100000:2.0:1788619947.196127:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657027072 00000100:00100000:2.0:1788619947.196198:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788619947.196209:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+38:10400:x1875503657027072:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1788619947.196303:0:8707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619947.196350:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe4e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a94e expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.196376:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.196383:0:8707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619947.196672:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.196690:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.196703:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788619947.196764:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788619947.197372:0:8707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000301903cf reply state 00000000ef3599dc transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.197388:0:8707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619947.197669:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+40:10400:x1875503657027072:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 1458us (1815us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788619947.197679:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000020:00080000:2.0:1788619947.197697:0:8707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788619947.201051:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201074:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201083:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201090:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eac00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619947.201096:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201105:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201131:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:1.0:1788619947.201135:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619947.201140:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.201168:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe4e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619947.361819:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619947.361974:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657027200 00000100:00100000:3.0:1788619947.361987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657027200 00000100:00100000:3.0:1788619947.362078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788619947.362090:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+39:10414:x1875503657027200:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:3.0:1788619947.362120:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619947.362147:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a955 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362253:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362267:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362295:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362302:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362333:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362585:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362596:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362604:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619947.362654:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788619947.362660:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619947.362689:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362703:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362713:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362720:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362728:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362734:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619947.362739:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.362755:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363246:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:3.0:1788619947.363254:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619947.363264:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363272:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe4f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363300:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363307:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363314:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363320:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619947.363323:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363329:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933388291900) 00010000:00010000:3.0:1788619947.363343:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619947.363346:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363367:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe4fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363418:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe4f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363844:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.363854:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619947.363857:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619947.363860:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:3.0:1788619947.363957:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+40:10414:x1875503657027200:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1868us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619947.363967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:2.0:1788619947.463210:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619947.465921:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.466759:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657027456 00000100:00100000:0.0:1788619947.466818:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657027456 00000100:00100000:0.0:1788619947.466910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788619947.466923:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+40:10424:x1875503657027456:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619947.466951:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619947.466981:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe50c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a95c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619947.467105:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788619947.467271:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe50c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a95c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.467299:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:0.0:1788619947.467303:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619947.467331:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe50c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a95c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.467350:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2c00, rc 0) 00000100:00100000:0.0:1788619947.467447:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+41:10424:x1875503657027456:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 527us (1540us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788619947.467455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788619947.475976:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.476086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657027712 00000100:00100000:2.0:1788619947.476099:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657027712 00000100:00100000:2.0:1788619947.476226:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788619947.476240:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+41:10424:x1875503657027712:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619947.476612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+42:10424:x1875503657027712:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 373us (650us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788619947.476622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788619947.536463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.537039:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657027968 00000100:00100000:2.0:1788619947.537053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657027968 00000100:00100000:2.0:1788619947.537151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788619947.537163:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+42:10430:x1875503657027968:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619947.537197:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619947.537233:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe51a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a963 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.537375:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.537394:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.537405:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.537450:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.537902:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 43 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.537921:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd244e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676981888:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619947.538046:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788619947.545059:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd244e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676981888:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619947.545366:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619947.546073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.546342:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657028096 00000100:00100000:2.0:1788619947.546354:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657028096 00010000:00010000:2.0:1788619947.546406:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 44 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.546450:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788619947.546461:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+44:2357:x1875503657028096:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619947.546480:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619947.546488:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 44 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546503:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 44 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546533:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe505 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a955 expref: 44 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546578:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.546584:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546595:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546605:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.546740:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619947.546868:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+43:2357:x1875503657028096:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 407us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.546877:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00010000:00010000:3.0:1788619947.547623:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.547635:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619947.547662:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788619947.548169:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe51a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.548195:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.548295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619947.548299:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788619947.548302:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:3.0:1788619947.548438:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+43:10430:x1875503657027968:12345-192.168.203.12@tcp:101:bash.0 Request processed in 11276us (11988us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788619947.548447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788619947.555443:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.555550:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657028352 00000100:00100000:0.0:1788619947.555564:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657028352 00000100:00100000:0.0:1788619947.555683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788619947.555705:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+43:10430:x1875503657028352:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788619947.556109:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.556133:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.556148:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619947.556453:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788619947.556490:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061b42e8f reply state 0000000027ab47b3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619947.556500:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788619947.556613:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+46:10430:x1875503657028352:12345-192.168.203.12@tcp:36:bash.0 Request processed in 910us (1184us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788619947.556621:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000020:00080000:0.0:1788619947.556627:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788619947.559307:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559330:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559338:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559345:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619947.559351:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559359:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559380:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619947.559384:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619947.559390:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.559397:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe52f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619947.565105:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619947.565272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657028480 00000100:00100000:3.0:1788619947.565297:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657028480 00000100:00100000:3.0:1788619947.565380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788619947.565391:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+45:10430:x1875503657028480:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619947.565424:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619947.565568:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a96a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.565687:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.565706:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.565936:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.565988:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.566007:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 46 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619947.566023:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd238380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676982016:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619947.566244:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619947.570151:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.570350:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657028608 00000100:00100000:2.0:1788619947.570364:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657028608 00010000:00010000:2.0:1788619947.570416:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 47 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.570469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788619947.570480:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:2354:x1875503657028608:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619947.570498:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619947.570506:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 47 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.570521:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 47 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.570562:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.570568:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.570579:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.570589:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.570599:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe521 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a963 expref: 47 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.570615:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619947.570727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:2354:x1875503657028608:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 247us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.570736:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788619947.570754:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd238380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676982016:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619947.570833:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.570846:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.570853:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619947.570912:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788619947.570917:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619947.570941:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.570976:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a96a expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.570993:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a96a expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.571002:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619947.571005:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619947.571008:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfc00, rc 0) 00000100:00100000:3.0:1788619947.571051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+45:10430:x1875503657028480:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5662us (5961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619947.571058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788619947.574703:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619947.574995:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657028864 00000100:00100000:3.0:1788619947.575009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657028864 00000100:00100000:0.0:1788619947.575311:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788619947.575327:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+45:10430:x1875503657028864:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788619947.575664:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+46:10430:x1875503657028864:12345-192.168.203.12@tcp:35:bash.0 Request processed in 340us (974us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788619947.575673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788619947.642028:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.642131:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657029120 00000100:00100000:2.0:1788619947.642146:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657029120 00000100:00100000:2.0:1788619947.642230:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788619947.642242:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+46:10440:x1875503657029120:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619947.642291:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619947.642318:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a971 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619947.643298:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788619947.644273:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe544 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a971 expref: 48 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.644308:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:2.0:1788619947.644330:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619947.644338:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a971 expref: 48 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.644357:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eaa00, rc 0) 00000100:00100000:2.0:1788619947.644683:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+47:10440:x1875503657029120:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2440us (2671us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788619947.644694:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788619947.648597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.648732:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657029248 00000100:00100000:2.0:1788619947.648746:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657029248 00000100:00100000:2.0:1788619947.655918:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788619947.655934:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:10440:x1875503657029248:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788619947.656147:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656169:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656183:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656204:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656211:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656218:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656355:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656380:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656388:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619947.656442:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656456:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656464:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656470:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656476:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.656481:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656490:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656506:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619947.656509:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.656515:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656521:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656542:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656548:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656555:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656560:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.656563:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656569:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656576:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fac00) 00010000:00010000:2.0:1788619947.656578:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.656581:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656588:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656603:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656610:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656616:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656631:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.656635:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656641:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656650:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.656652:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.656656:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.656663:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619947.657028:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:10440:x1875503657029248:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1093us (8443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.657038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788619947.667253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.669312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657029504 00000100:00100000:2.0:1788619947.669334:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657029504 00000100:00100000:2.0:1788619947.669427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788619947.669505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:10440:x1875503657029504:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619947.673968:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+48:10440:x1875503657029504:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 4514us (6711us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788619947.673985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788619947.726611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619947.726710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657029760 00000100:00100000:3.0:1788619947.726736:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657029760 00000100:00100000:3.0:1788619947.727058:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788619947.727072:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+48:10443:x1875503657029760:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619947.727107:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619947.727133:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a978 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727231:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727249:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727263:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727292:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727300:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727307:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727478:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe57c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727510:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe57c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727517:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe57c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619947.727529:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788619947.727651:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727659:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727666:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727672:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619947.727677:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727686:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727701:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:3.0:1788619947.727705:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619947.727710:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727717:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe56e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727734:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727746:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727753:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727759:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619947.727762:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727769:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727844:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933388291900) 00010000:00010000:3.0:1788619947.727847:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619947.727850:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727857:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727913:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a978 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727929:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe57c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a978 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619947.727937:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:3.0:1788619947.727939:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619947.727948:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31400, rc 0) 00000100:00100000:3.0:1788619947.728040:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:10443:x1875503657029760:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 971us (1443us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788619947.728049:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788619947.736239:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619947.737390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657029888 00000100:00100000:1.0:1788619947.737408:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657029888 00000100:00100000:1.0:1788619947.737521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788619947.737535:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:2354:x1875503657029888:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619947.737557:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619947.737604:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe57c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a978 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619947.737632:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:1.0:1788619947.737639:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619947.737725:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+49:2354:x1875503657029888:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 193us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619947.737735:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788619947.739086:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.739204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657030016 00000100:00100000:0.0:1788619947.739214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657030016 00000100:00100000:0.0:1788619947.739283:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788619947.739295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+49:10443:x1875503657030016:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788619947.739384:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739403:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739418:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739472:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739479:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739485:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619947.739507:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739517:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:0.0:1788619947.739534:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619947.739540:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.739547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe58a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619947.739640:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+49:10443:x1875503657030016:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 346us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619947.739649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788619947.745267:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619947.745344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657030272 00000100:00100000:1.0:1788619947.745358:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657030272 00000100:00100000:1.0:1788619947.745427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788619947.745454:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+49:10443:x1875503657030272:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788619947.745828:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:10443:x1875503657030272:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 374us (573us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788619947.745837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788619947.911149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.911883:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657030528 00000100:00100000:0.0:1788619947.911898:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657030528 00000100:00100000:0.0:1788619947.911971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788619947.911981:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:10461:x1875503657030528:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788619947.912006:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619947.912028:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a97f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.912118:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe598 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.912132:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.912162:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619947.912173:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788619947.912321:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a97f expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.912340:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a97f expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619947.912348:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:0.0:1788619947.912350:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788619947.912354:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788619947.912427:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+52:10461:x1875503657030528:12345-192.168.203.12@tcp:101:cat.0 Request processed in 448us (1293us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788619947.912433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788619947.938157:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.938267:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657030656 00000100:00100000:2.0:1788619947.938292:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657030656 00000100:00100000:2.0:1788619947.938369:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788619947.938401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+52:10462:x1875503657030656:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619947.938425:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619947.938447:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a986 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938514:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938528:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938540:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619947.938575:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788619947.938578:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619947.938594:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a986 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938636:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a986 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.938644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619947.938647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619947.938651:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:2.0:1788619947.938724:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+53:10462:x1875503657030656:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 326us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.938740:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1788619947.945425:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619947.945536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031040 00000100:00100000:0.0:1788619947.945547:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031040 00000100:00100000:0.0:1788619947.945608:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788619947.945619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+53:10462:x1875503657031040:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619947.946367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+54:10462:x1875503657031040:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 747us (948us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788619947.946377:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788619947.951254:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.951393:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031168 00000100:00100000:2.0:1788619947.951406:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031168 00000100:00100000:2.0:1788619947.951496:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788619947.951508:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+54:10462:x1875503657031168:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:2.0:1788619947.951530:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788619947.951565:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe53d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a96a expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.951593:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a97f expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.951607:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a92b expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.951619:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fa700) 00010000:00010000:2.0:1788619947.951632:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619947.951732:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+51:10462:x1875503657031168:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 226us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.951740:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788619947.954683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.954891:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031296 00000100:00100000:2.0:1788619947.954904:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031296 00000100:00100000:2.0:1788619947.954966:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788619947.954979:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+51:10462:x1875503657031296:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1788619947.955147:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.955177:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.955192:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788619947.955578:0:8707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788619947.955877:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788619947.955947:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788619947.956078:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+51:10462:x1875503657031296:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 1096us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.956088:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1788619947.991552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619947.992256:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031424 00000100:00100000:2.0:1788619947.992271:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031424 00000100:00100000:2.0:1788619947.992354:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788619947.992365:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+51:10464:x1875503657031424:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619947.992393:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619947.992433:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe5bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a98d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992555:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992574:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992589:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992618:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992625:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.992632:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993112:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993123:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993131:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619947.993178:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788619947.993182:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619947.993202:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993216:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993226:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993233:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993253:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993260:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.993265:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993286:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993300:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619947.993304:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.993310:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993318:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe5c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993333:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993339:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993345:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993349:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eaa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619947.993352:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993370:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993377:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fa700) 00010000:00010000:2.0:1788619947.993379:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619947.993382:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993388:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe5c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993631:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe5bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993648:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619947.993655:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:2.0:1788619947.993657:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619947.993660:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619947.994127:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+52:10464:x1875503657031424:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1761us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619947.994137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00010000:00010000:0.0:1788619948.488677:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788619948.742961:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788619948.742978:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788619948.743029:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788619948.743107:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619948.743225:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb97100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676982144:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788619948.743390:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619948.751849:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb97100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676982144:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788619948.770247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619948.770765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031552 00000100:00100000:0.0:1788619948.770791:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031552 00000100:00100000:0.0:1788619948.770845:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788619948.770854:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031552:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788619948.770935:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031552:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 82us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619948.770943:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788619948.777651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619948.781056:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031680 00000100:00100000:3.0:1788619948.781071:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031680 00000100:00100000:3.0:1788619948.781188:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788619948.781200:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031680:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788619948.781230:0:8707:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788619948.781350:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031680:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 152us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619948.781358:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788619948.796090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619948.796209:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657031808 00000100:00100000:3.0:1788619948.796219:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657031808 00000100:00100000:3.0:1788619948.796294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788619948.796303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031808:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788619948.796383:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796400:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796433:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796491:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796509:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796517:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796545:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796553:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796559:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619948.796709:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788619948.796713:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619948.796725:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796736:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796743:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796758:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796765:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619948.796791:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796854:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796867:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:3.0:1788619948.796870:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619948.796874:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796880:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31600/0xbb0e330328bbe5d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796891:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796897:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796902:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796906:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619948.796908:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796923:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796930:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff933388291800) 00010000:00010000:3.0:1788619948.796933:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619948.796936:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796942:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe5de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796957:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796963:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796968:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796973:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619948.796976:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796981:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.796989:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:3.0:1788619948.796991:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619948.796994:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.797008:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe5e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619948.797079:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657031808:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 776us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619948.797087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788619948.803618:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619948.808196:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657032064 00000100:00100000:1.0:1788619948.808210:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657032064 00000100:00100000:1.0:1788619948.808292:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788619948.808302:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+52:10475:x1875503657032064:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619948.808323:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619948.808343:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbe5ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a994 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808455:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808469:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808481:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619948.808493:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788619948.808964:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808981:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808988:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.808994:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619948.808999:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809007:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809020:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:1.0:1788619948.809024:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788619948.809028:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809034:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe5f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809076:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbe5ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a994 expref: 54 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809085:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:1.0:1788619948.809087:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788619948.809091:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbe5ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a994 expref: 54 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.809099:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143c00, rc 0) 00000100:00100000:1.0:1788619948.809177:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+53:10475:x1875503657032064:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 875us (5568us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788619948.809184:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000001:00080000:0.0:1788619948.815458:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1788619948.815481:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788619948.815504:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333bc58d840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788619948.815509:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bb7ebe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333bc58df00 00000020:00080000:0.0:1788619948.815513:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bb7eb000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9333bc7a8c00 00000100:00100000:2.0:1788619948.815728:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619948.815747:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676982272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788619948.815850:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619948.815917:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676982272 00000100:00100000:2.0:1788619948.815924:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676982272 00000020:00080000:1.0:1788619948.815998:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788619948.816092:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788619948.816102:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788619948.816110:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676982272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788619948.816133:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788619948.816165:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c2caa, atime: 0x6a9c2caa, ctime: 0x6a9c2caa, blocks: 0x1 00010000:00010000:2.0:1788619948.816174:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816190:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788619948.816195:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619948.816201:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816217:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816227:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816235:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816251:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788619948.816722:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676982272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 612us (871us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788619948.816731:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788619948.816762:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788619948.816796:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619948.816869:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816878:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eaa00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619948.816883:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816893:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816909:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.816916:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe29508/0xbb0e330328bbe601 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.817013:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619948.817015:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619948.817017:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788619948.817066:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bd247100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788619948.817072:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676982272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788619948.829380:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619948.829412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657032192 00000100:00100000:3.0:1788619948.829422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657032192 00000100:00100000:3.0:1788619948.829471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788619948.829481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657032192:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788619948.829513:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788619948.829611:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657032192:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619948.829619:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788619948.837090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619948.838765:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657032448 00000100:00100000:1.0:1788619948.838883:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657032448 00000100:00100000:1.0:1788619948.838952:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788619948.838962:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657032448:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619948.838981:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619948.838984:0:8707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788619948.839007:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe5ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a986 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.839024:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:1.0:1788619948.839030:0:8707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619948.839042:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbe608 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a99b expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788619948.840280:0:8707:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788619948.840542:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe60f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.840556:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.840567:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.840639:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbe608 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a99b expref: 14 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.840655:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a99b expref: 13 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.840662:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff933390117500) 00010000:00010000:1.0:1788619948.840665:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619948.840668:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143a00, rc 0) 00000100:00100000:1.0:1788619948.841158:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657032448:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2194us (4073us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788619948.841166:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788619948.872687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619948.872719:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657032704 00000100:00100000:3.0:1788619948.872740:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657032704 00000100:00100000:3.0:1788619948.873625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1788619948.873639:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657032704:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788619948.873695:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619948.873722:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbe60f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a99b expref: 13 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.873737:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff933390117500) 00010000:00010000:3.0:1788619948.873755:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619948.874071:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874086:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874096:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874158:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874167:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874173:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874376:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874385:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874392:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874398:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619948.874402:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874420:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874435:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:3.0:1788619948.874438:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619948.874442:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874449:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe61d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874459:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874465:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874471:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619948.874480:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874486:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78841717 (ffff933388291800) 00010000:00010000:3.0:1788619948.874495:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619948.874506:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619948.874512:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78841717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619948.874614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657032704:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 977us (1934us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788619948.874622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000040:00080000:0.0:1788619948.876611:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788619948.876620:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788619948.876671:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788619948.876678:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619948.879861:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619948.879937:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657032832 00000100:00100000:2.0:1788619948.879947:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657032832 00000100:00100000:2.0:1788619948.880006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788619948.880016:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657032832:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619948.880044:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619948.880069:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe62b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880107:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880121:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880132:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880222:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe62b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880239:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.880248:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:2.0:1788619948.880251:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788619948.880255:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eae00, rc 0) 00000100:00100000:2.0:1788619948.880324:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657032832:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 310us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619948.880331:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1788619948.889094:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619948.894405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033088 00000100:00100000:2.0:1788619948.894488:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033088 00000100:00100000:2.0:1788619948.894629:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788619948.894639:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657033088:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788619948.894727:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.894744:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.894756:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788619948.895231:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788619948.895242:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351863469506ns, next at 352863467084ns, rc = 0 00000004:00010000:2.0:1788619948.895337:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ef2ec0c reply state 000000004b0be813 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619948.895346:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619948.895579:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:10475:x1875503657033088:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 940us (6491us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788619948.895587:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1788619948.900095:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1788619948.900235:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900249:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900257:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900263:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619948.900279:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900296:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900325:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:1.0:1788619948.900328:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788619948.900334:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.900340:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe639 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619948.900432:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033216 00000100:00100000:2.0:1788619948.900441:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033216 00000100:00100000:2.0:1788619948.900551:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788619948.900563:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+14:10475:x1875503657033216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619948.900596:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619948.900629:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9a9 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.900707:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 15 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.900755:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 15 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.900926:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:2.0:1788619948.900929:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788619948.900932:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:2.0:1788619948.901083:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:10475:x1875503657033216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 522us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619948.901090:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788619948.915178:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619948.915249:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033344 00000100:00100000:0.0:1788619948.915261:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033344 00000100:00100000:0.0:1788619948.915325:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788619948.915333:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875503657033344:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788619948.915391:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788619948.915428:0:6691:0:(genops.c:1385:class_connect()) connect: client 11f76a03-c7c3-4513-8603-309aac0577a7, cookie 0xbb0e330328bbe647 00002000:00100000:0.0:1788619948.915441:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11f76a03-c7c3-4513-8603-309aac0577a7/ffff9333836dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788619948.915470:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788619948.915718:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788619948.915751:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9333836d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788619948.915843:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2353:x1875503657033344:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 Request processed in 509us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619948.915851:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788619948.927656:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619948.928002:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033472 00000100:00100000:2.0:1788619948.928012:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033472 00000100:00100000:2.0:1788619948.928083:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788619948.928098:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:0:x1875503657033472:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788619948.928542:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619948.968576:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:0:x1875503657033472:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 40473us (40918us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788619948.968589:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000001:00100000:3.0:1788619948.968951:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000001:00080000:3.0:1788619948.968965:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788619948.970885:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619948.970919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033728 00000100:00100000:3.0:1788619948.970927:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033728 00000100:00100000:3.0:1788619948.970984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788619948.970993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:10475:x1875503657033728:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788619948.971207:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:10475:x1875503657033728:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 214us (330us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788619948.971214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788619948.973909:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619948.973969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657033984 00000100:00100000:1.0:1788619948.973978:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657033984 00000100:00100000:1.0:1788619948.974032:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788619948.974043:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:10475:x1875503657033984:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788619948.974157:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:10475:x1875503657033984:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619948.974165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1788619948.976328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619948.976494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034112 00000100:00100000:1.0:1788619948.976578:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034112 00000100:00100000:1.0:1788619948.976674:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788619948.976686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:10475:x1875503657034112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619948.976706:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619948.976725:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe64e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976810:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976825:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976844:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619948.976878:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619948.976894:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe64e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b0 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976938:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b0 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619948.976948:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:1.0:1788619948.976951:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788619948.976955:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143200, rc 0) 00000100:00100000:1.0:1788619948.977013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657034112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 330us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619948.977021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788619948.979574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619948.979654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034240 00000100:00100000:2.0:1788619948.979664:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034240 00000100:00100000:2.0:1788619948.979718:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788619948.979728:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657034240:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619948.979744:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619948.979764:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9b7 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619948.979829:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2cad, blocks: 0x1 00010000:00010000:2.0:1788619948.979854:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788619948.979859:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619948.979869:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.979888:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619948.979901:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:2.0:1788619948.979956:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657034240:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 230us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619948.979963:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788619948.988756:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619948.989022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034496 00000100:00100000:1.0:1788619948.989033:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034496 00000100:00100000:1.0:1788619948.989114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788619948.989123:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657034496:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788619948.989224:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657034496:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 102us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619948.989231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788619948.992606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619948.994164:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034624 00000100:00100000:0.0:1788619948.994177:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034624 00000100:00100000:0.0:1788619948.994245:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788619948.994256:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:10475:x1875503657034624:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619948.994281:0:8933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619948.994304:0:8933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9be expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619948.994333:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619948.994342:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619948.994346:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619948.994352:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619948.994401:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619948.994846:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619948.994863:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676982400:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619948.994958:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619949.004246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.004282:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676982400:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619949.004318:0:8933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.004347:0:8933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2000, rc 0) 00000100:00100000:0.0:1788619949.004477:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:10475:x1875503657034624:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 10165us (11823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619949.004486:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788619949.004800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034752 00000100:00100000:3.0:1788619949.004807:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034752 00010000:00010000:3.0:1788619949.004839:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.004883:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788619949.004892:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387305c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657034752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619949.004905:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619949.004927:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.004939:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.004961:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acbc4707/0xbb0e330328bbe65c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b7 expref: 7 pid: 6691 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.004972:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619949.004976:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619949.004984:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 6 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.004994:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 6 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.005026:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 6 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.005039:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875503676982528:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788619949.005091:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390000 going to sleep for 11 seconds 00000100:00100000:1.0:1788619949.016855:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386712300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875503676982528:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788619949.016884:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619949.016931:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387305c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657034752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 12040us (12695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619949.016942:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788619949.020073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.020163:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657034880 00000100:00100000:3.0:1788619949.020173:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657034880 00002000:00100000:3.0:1788619949.020222:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9333bb6e6a00 x1875503657034880/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:45/0 lens 504/0 e 0 to 0 dl 1788619960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619949.020233:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bb6e6a00 with x1875503657034880 ext(0->8) 00002000:00010000:3.0:1788619949.020240:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bb6e6a00 00000100:00100000:3.0:1788619949.020279:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788619949.020290:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657034880:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788619949.021496:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657034880:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1202us (1427us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788619949.023218:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:3.0:1788619949.023235:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9333bb6e6a00 x1875503657034880/t4294967302(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:45/0 lens 504/448 e 0 to 0 dl 1788619960 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619949.023245:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bb6e6a00 with x1875503657034880 ext(0->8) 00002000:00010000:3.0:1788619949.023251:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bb6e6a00 00000100:00100000:2.0:1788619949.027219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.027307:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035008 00000100:00100000:0.0:1788619949.027319:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035008 00000100:00100000:0.0:1788619949.027431:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788619949.027443:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657035008:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1788619949.030063:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619949.104330:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657035008:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 76880us (77111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619949.104343:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000001:00080000:0.0:1788619949.104386:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:0.0:1788619949.104397:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1788619949.104429:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788619949.104434:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1788619949.104445:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788619949.104578:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788619949.104588:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788619949.104710:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676982656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788619949.104759:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619949.105905:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676982656 00000100:00100000:2.0:1788619949.105915:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676982656 00000100:00100000:2.0:1788619949.105977:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788619949.105985:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676982656:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788619949.106012:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788619949.106153:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788619949.106157:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788619949 00002000:00010000:2.0:1788619949.106159:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788619949.106161:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788619949 -> 1788619949 00002000:00010000:2.0:1788619949.106163:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788619949.106228:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676982656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (1469us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788619949.106235:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:0.0:1788619949.106320:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bb923100/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788619949.106326:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676982656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788619949.109794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.110219:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035136 00000100:00100000:3.0:1788619949.110229:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035136 00000100:00100000:3.0:1788619949.110328:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788619949.110338:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2357:x1875503657035136:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788619949.142674:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2357:x1875503657035136:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 32327us (32898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.142688:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000001:00080000:3.0:1788619949.142745:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788619949.142792:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788619949.145815:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619949.145942:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035392 00000100:00100000:1.0:1788619949.145953:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035392 00000100:00100000:1.0:1788619949.146009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:1.0:1788619949.146019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657035392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788619949.146069:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619949.146096:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbe655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9b0 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.146115:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:1.0:1788619949.146121:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619949.146148:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.146162:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.146172:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619949.146420:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db2797da reply state 0000000097bb0631 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619949.146445:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788619949.146539:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:10475:x1875503657035392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 521us (773us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788619949.146547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00010000:00010000:3.0:1788619949.149308:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149326:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149333:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149339:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619949.149344:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149352:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149368:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:3.0:1788619949.149371:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619949.149377:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.149383:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbe66a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619949.150224:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619949.150303:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035520 00000100:00100000:2.0:1788619949.150313:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035520 00000100:00100000:2.0:1788619949.150370:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788619949.150379:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657035520:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788619949.150614:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788619949.150617:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788619949 -> 1788619948 00002000:00010000:2.0:1788619949.150634:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788619946 00002000:00010000:2.0:1788619949.150637:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788619949 -> 1788619948 00002000:00010000:2.0:1788619949.150640:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788619949.150886:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333b94fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657035520:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 505us (665us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788619949.150895:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:0.0:1788619949.154371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619949.155533:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035776 00000100:00100000:1.0:1788619949.155545:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035776 00000100:00100000:1.0:1788619949.155672:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788619949.155684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:10475:x1875503657035776:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788619949.155765:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.155798:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.155808:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.155844:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.155857:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 13 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619949.155871:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676982784:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619949.155981:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333850a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619949.161570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.161873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657035904 00000100:00100000:3.0:1788619949.161884:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657035904 00010000:00010000:3.0:1788619949.161924:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 14 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.161970:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788619949.161981:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:2355:x1875503657035904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619949.162012:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619949.162019:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 14 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.162032:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 14 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.162055:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:3.0:1788619949.162062:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.162072:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.162079:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.162099:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619949.162154:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:2355:x1875503657035904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 174us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.162161:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:2.0:1788619949.163004:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a2 expref: 13 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619949.163024:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676982784:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619949.163048:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163058:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163064:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163091:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163098:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163127:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163133:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619949.163137:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163146:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163158:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:2.0:1788619949.163161:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788619949.163165:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.163171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe671 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619949.163243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657035776:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 7562us (8881us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788619949.163253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1788619949.167151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.167228:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036032 00000100:00100000:0.0:1788619949.167238:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036032 00000100:00100000:0.0:1788619949.167376:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788619949.167387:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657036032:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788619949.167444:0:8933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.167463:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.167473:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788619949.167490:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619949.167505:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.167558:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 7 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.167571:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 7 pid: 8933 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619949.167583:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676982912:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619949.167658:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619949.174492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.174659:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676982912:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619949.174691:0:8933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619949.175382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036160 00000100:00100000:2.0:1788619949.175391:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036160 00010000:00010000:2.0:1788619949.175626:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 8 pid: 8933 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619949.175672:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788619949.175682:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657036160:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619949.175711:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619949.175735:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 8 pid: 8933 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.175749:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 8 pid: 8933 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.175893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbe663 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9be expref: 8 pid: 8933 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.175911:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619949.175915:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619949.175921:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.175931:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.175994:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619949.176055:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657036160:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 374us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619949.176063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00010000:00010000:0.0:1788619949.176580:0:8933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176592:0:8933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176618:0:8933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176627:0:8933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176653:0:8933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176660:0:8933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619949.176665:0:8933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176674:0:8933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176691:0:8933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619949.176698:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d90afe2/0xbb0e330328bbe678 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619949.176766:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657036032:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 9381us (9623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619949.176815:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788619949.180793:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619949.180908:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036416 00000100:00100000:2.0:1788619949.180917:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036416 00000100:00100000:2.0:1788619949.180973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1788619949.180986:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+12:10475:x1875503657036416:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788619949.181072:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181089:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181102:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181317:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181328:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 13 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181338:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181369:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 13 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.181382:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 13 pid: 8707 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619949.181395:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd246680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676983040:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619949.181683:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc3903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619949.188548:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.188630:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036544 00000100:00100000:3.0:1788619949.188640:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036544 00010000:00010000:3.0:1788619949.188676:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 14 pid: 8707 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.188716:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788619949.188726:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+14:2355:x1875503657036544:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619949.188760:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619949.188768:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 14 pid: 8707 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.188822:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 14 pid: 8707 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.188844:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:3.0:1788619949.188849:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.188859:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.188866:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.188887:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619949.188941:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+14:2355:x1875503657036544:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 216us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.188948:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:1.0:1788619949.189237:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe640 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9a9 expref: 13 pid: 8707 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619949.189255:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd246680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676983040:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619949.189292:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.189302:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.189307:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619949.189491:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788619949.189653:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788619949.189696:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788619949.189911:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676983168:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619949.189960:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619949.190099:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390321480 going to sleep for 11 seconds 00000100:00100000:2.0:1788619949.190466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983168 00000100:00100000:2.0:1788619949.190473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983168 00000100:00100000:2.0:1788619949.190958:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788619949.190980:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875503676983168:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788619949.191070:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875503676983168:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619949.191078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788619949.191145:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788619949.191151:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bb923100, transno 4294967303 00000100:00100000:3.0:1788619949.191172:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb6e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676983168:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788619949.191744:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788619949.191828:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676983296:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788619949.191867:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619949.194204:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983296 00000100:00100000:1.0:1788619949.194218:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983296 00000100:00100000:3.0:1788619949.194240:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619949.194380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788619949.194392:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875503676983296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619949.194654:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676983296:12345-0@lo:1000:mdt00_001.0 Request processed in 264us (2784us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788619949.194662:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788619949.194746:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676983296:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788619949.194816:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194826:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194833:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194839:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eaa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619949.194844:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194851:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194867:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9333838fa400) 00010000:00010000:3.0:1788619949.194869:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619949.194874:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194879:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe686 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194914:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194926:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194940:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619949.194943:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194950:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194958:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:3.0:1788619949.194961:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619949.194964:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194970:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe5b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.194996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.195009:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.195018:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.195047:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.195061:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 16 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.196509:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676983424:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619949.196608:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788619949.203174:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676983424:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619949.203206:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619949.205224:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619949.208495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036672 00000100:00100000:1.0:1788619949.208509:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036672 00010000:00010000:1.0:1788619949.208560:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 17 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619949.208627:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788619949.208637:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+17:2355:x1875503657036672:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619949.208654:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619949.208662:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 17 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208676:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 17 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208700:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe5d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a98d expref: 17 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208720:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:1.0:1788619949.208726:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208736:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208743:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619949.208819:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619949.208881:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:2355:x1875503657036672:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 245us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619949.208888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:3.0:1788619949.210610:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210625:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210639:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210646:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210653:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210659:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619949.210663:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210670:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210685:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:3.0:1788619949.210703:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619949.210709:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210716:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbe68d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210731:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210736:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210741:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210747:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eae00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619949.210750:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210756:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210763:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fac00) 00010000:00010000:3.0:1788619949.210766:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788619949.210768:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.210807:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe67f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788619949.211139:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619949.211144:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788619949.211160:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:10475:x1875503657036416:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 30173us (30397us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788619949.211169:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000020:00080000:2.0:1788619949.211175:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788619949.211177:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788619949.211182:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619949.214543:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.215639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657036928 00000100:00100000:3.0:1788619949.215650:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657036928 00000100:00100000:3.0:1788619949.215754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788619949.215765:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:10475:x1875503657036928:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788619949.216605:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788619949.216860:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788619949.216909:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216926:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216946:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216952:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216959:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619949.216982:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788619949.217018:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619949.217025:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.217031:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619949.217035:0:7635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.217042:0:7635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.217054:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff933388291800) 00010000:00010000:2.0:1788619949.217057:0:7635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788619949.217061:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619949.217066:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe694 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619949.217069:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+17:10475:x1875503657036928:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1304us (2535us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788619949.217078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000020:00080000:3.0:1788619949.217083:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788619949.217084:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619949.217085:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619949.217087:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619949.513354:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619949.979492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.979548:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.979584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.979612:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619949.979678:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619949.979921:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037056 00000100:00100000:3.0:1788619949.979931:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037056 00000100:00100000:3.0:1788619949.979991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:3.0:1788619949.980002:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657037056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619949.980015:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037184 00000100:00100000:2.0:1788619949.980021:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037184 00000100:00100000:3.0:1788619949.980071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657037056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.980079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:2.0:1788619949.980130:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037568 00000100:00100000:2.0:1788619949.980135:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037568 00000100:00100000:3.0:1788619949.980141:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037440 00000100:00100000:3.0:1788619949.980148:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037440 00000100:00100000:2.0:1788619949.980176:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788619949.980183:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037312 00000100:00100000:2.0:1788619949.980187:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:2356:x1875503657037184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619949.980189:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037312 00000100:00100000:3.0:1788619949.980222:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788619949.980231:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:2356:x1875503657037184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.980236:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657037440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619949.980278:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657037440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.980284:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788619949.980363:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:2.0:1788619949.980384:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1788619949.980394:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657037568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619949.980425:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657037568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619949.980432:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:3.0:1788619949.980440:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1788619949.980451:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657037312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:2.0:1788619949.980455:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619949.980461:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619949.980482:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657037312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619949.980490:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788619950.281681:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676983552:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.281751:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.281824:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676984064:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.281862:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.281888:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788619950.281894:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676983680:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.281914:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.281929:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676984192:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.281949:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.281992:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676984064 00000100:00100000:2.0:1788619950.281999:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676984064 00000100:00100000:2.0:1788619950.282045:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983680 00000100:00100000:2.0:1788619950.282048:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983680 00000100:00100000:2.0:1788619950.282067:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788619950.282075:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676984064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619950.282236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983552 00000100:00100000:1.0:1788619950.282248:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983552 00000100:00100000:1.0:1788619950.282288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788619950.282295:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676983552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619950.282337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503676983552:12345-0@lo:400:kworker.0 Request processed in 43us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619950.282344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788619950.282944:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676983808:0@lo:400:kworker.0 00000100:00100000:0.0:1788619950.282983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619950.283003:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788619950.283010:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676983936:0@lo:400:kworker.0 00000100:00100000:0.0:1788619950.283032:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.283221:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503676984064:12345-0@lo:400:kworker.0 Request processed in 1145us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.283229:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788619950.283248:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983808 00000100:00100000:2.0:1788619950.283253:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983808 00000100:00100000:2.0:1788619950.283291:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788619950.283297:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676983680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.283331:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676983680:12345-0@lo:400:kworker.0 Request processed in 34us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.283337:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788619950.283349:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788619950.285500:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676983808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.285645:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503676983808:12345-0@lo:400:kworker.0 Request processed in 2288us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.285653:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788619950.285699:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676984192 00000100:00100000:2.0:1788619950.285705:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676984192 00000100:00100000:2.0:1788619950.285735:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676983936 00000100:00100000:2.0:1788619950.285737:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676983936 00000100:00100000:2.0:1788619950.285763:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788619950.285783:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676984192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.285810:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676984192:12345-0@lo:400:kworker.0 Request processed in 42us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.285822:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788619950.285903:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788619950.285912:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503676983936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619950.285942:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503676983936:12345-0@lo:400:kworker.0 Request processed in 33us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619950.285947:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788619950.286065:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676983936:0@lo:400:kworker.0 00000100:00100000:0.0:1788619950.286076:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503676983808:0@lo:400:kworker.0 00000100:00080000:2.0:1788619950.286490:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619950.286495:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619950.286528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676983680:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.286541:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676984192:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.286550:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503676983552:0@lo:400:kworker.0 00000100:00100000:2.0:1788619950.286560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503676984064:0@lo:400:kworker.0 00010000:00010000:0.0:1788619950.538549:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788619950.706028:0:12066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619950.706036:0:12066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619950.706073:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788619950.706080:0:12066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619950.796061:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619950.796083:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676984320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619950.796148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619950.796305:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676984320 00000100:00100000:2.0:1788619950.796312:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676984320 00000100:00100000:2.0:1788619950.796546:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788619950.796556:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676984320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788619950.796590:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619950.796649:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676984320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.796656:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788619950.796723:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676984320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619950.882590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.882816:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037824 00000100:00100000:2.0:1788619950.882827:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037824 00000100:00100000:2.0:1788619950.882898:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788619950.882909:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:10494:x1875503657037824:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619950.882929:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619950.882950:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe69b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9c5 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.883061:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe6a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.883089:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.883102:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619950.883115:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788619950.883250:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe69b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9c5 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.883281:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9c5 expref: 19 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.883290:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619950.883293:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788619950.883297:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ea000, rc 0) 00000100:00100000:2.0:1788619950.883918:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:10494:x1875503657037824:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1008us (1335us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788619950.883927:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788619950.890230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.890374:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657037952 00000100:00100000:2.0:1788619950.890388:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657037952 00000100:00100000:2.0:1788619950.890474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1788619950.890487:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:10494:x1875503657037952:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788619950.890598:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.890621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.890659:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.890678:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.890686:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.890692:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891323:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891334:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891342:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619950.891396:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891412:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891420:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891427:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891445:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619950.891451:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891461:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891476:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619950.891480:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619950.891486:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891493:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891506:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891512:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891518:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891523:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eae00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619950.891525:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891531:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891550:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838faf00) 00010000:00010000:2.0:1788619950.891552:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619950.891556:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891563:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891581:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891586:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891592:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891597:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eac00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619950.891600:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891605:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891612:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838fab00) 00010000:00010000:2.0:1788619950.891615:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619950.891617:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.891623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619950.892169:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:10494:x1875503657037952:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1678us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619950.892182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788619950.936197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.940088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657038208 00000100:00100000:2.0:1788619950.940123:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657038208 00000100:00100000:2.0:1788619950.940225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1788619950.940238:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+19:10497:x1875503657038208:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619950.940273:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619950.940303:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9cc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940417:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940431:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940448:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940456:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940462:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940872:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940884:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.940892:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619950.940903:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788619950.941018:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941026:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941033:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941039:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eae00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619950.941045:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941053:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941067:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619950.941071:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619950.941077:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941094:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe6cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941111:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941117:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941122:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941127:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619950.941130:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941135:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941143:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fab00) 00010000:00010000:2.0:1788619950.941146:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619950.941149:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941154:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941207:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941225:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.941240:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:2.0:1788619950.941243:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619950.941245:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb400, rc 0) 00000100:00100000:2.0:1788619950.941342:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:10497:x1875503657038208:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1105us (5160us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788619950.941351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1788619950.946391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.948639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657038336 00000100:00100000:2.0:1788619950.948661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657038336 00000100:00100000:2.0:1788619950.948745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1788619950.948756:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:10497:x1875503657038336:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788619950.949183:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949205:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949220:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949265:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949274:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949303:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949309:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619950.949315:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949324:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949338:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:1.0:1788619950.949342:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788619950.949347:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619950.949354:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbe6e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619950.949456:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:10497:x1875503657038336:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 699us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619950.949464:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788619950.954866:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619950.954946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657038592 00000100:00100000:0.0:1788619950.954955:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657038592 00000100:00100000:0.0:1788619950.955011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788619950.955021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+21:10497:x1875503657038592:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619950.955244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+22:10497:x1875503657038592:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 224us (666us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788619950.955262:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788619950.988951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.989048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657038848 00000100:00100000:2.0:1788619950.989058:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657038848 00000100:00100000:2.0:1788619950.989117:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1788619950.989127:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+22:10017:x1875503657038848:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619950.989150:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619950.989171:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.989280:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.989294:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.989303:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.989350:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619950.989362:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 23 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619950.989375:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd244000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676984448:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619950.989474:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc3903c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619950.993295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619950.993411:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd244000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676984448:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619950.993437:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619950.993504:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657038976 00000100:00100000:3.0:1788619950.993511:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657038976 00010000:00010000:3.0:1788619950.993546:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 24 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619950.993599:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788619950.993609:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+24:2355:x1875503657038976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619950.993623:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619950.993630:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 24 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993641:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 24 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993661:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe6da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9cc expref: 24 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993676:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:3.0:1788619950.993680:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993690:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993697:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619950.993734:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619950.993866:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619950.993883:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619950.993900:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788619950.994021:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe6ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619950.994036:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619950.994043:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619950.994046:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619950.994048:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:3.0:1788619950.994178:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+24:2355:x1875503657038976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 570us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619950.994185:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788619950.994601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+23:10017:x1875503657038848:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5475us (5659us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788619950.994609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788619950.997098:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619950.997155:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657039232 00000100:00100000:0.0:1788619950.997163:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657039232 00000100:00100000:0.0:1788619950.997211:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788619950.997219:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+23:10017:x1875503657039232:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788619950.997482:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619950.997499:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619950.997510:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619950.997574:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788619950.997597:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014b5f24e reply state 0000000064ef4113 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619950.997606:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788619950.997679:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788619950.998224:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:10017:x1875503657039232:12345-192.168.203.12@tcp:36:bash.0 Request processed in 1003us (1131us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788619950.998233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000020:00080000:0.0:1788619950.998238:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788619951.000133:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000149:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000157:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000163:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.000168:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000177:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000193:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:2.0:1788619951.000210:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.000215:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.000222:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe704 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.001385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.001452:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657039360 00000100:00100000:0.0:1788619951.001461:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657039360 00000100:00100000:0.0:1788619951.001522:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1788619951.001532:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+26:10017:x1875503657039360:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619951.001552:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.001568:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe70b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9da expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.001621:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe70b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9da expref: 27 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.001635:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe70b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9da expref: 27 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.001652:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.001655:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619951.001658:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3600, rc 0) 00000100:00100000:0.0:1788619951.001728:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+27:10017:x1875503657039360:12345-192.168.203.12@tcp:101:bash.0 Request processed in 198us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.001735:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00080000:2.0:1788619951.001888:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619951.006463:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.006540:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657039488 00000100:00100000:3.0:1788619951.006561:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657039488 00000100:00100000:3.0:1788619951.006630:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788619951.006641:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:10017:x1875503657039488:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619951.006660:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619951.006679:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9e1 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619951.006704:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c2cac, atime: 0x6a9c2caa, ctime: 0x6a9c2cac, blocks: 0xb 00010000:00010000:3.0:1788619951.006724:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1788619951.006730:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619951.006737:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.006754:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.006767:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce000, rc 0) 00000100:00100000:3.0:1788619951.006849:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:10017:x1875503657039488:12345-192.168.203.12@tcp:101:bash.0 Request processed in 210us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.006856:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00080000:2.0:1788619951.006957:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619951.009231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.009329:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657039616 00000100:00100000:0.0:1788619951.009339:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657039616 00002000:00010000:0.0:1788619951.009378:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788619951.009383:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933386711880 with x1875503657039616 ext(0->18446744073709551615) 00002000:00010000:0.0:1788619951.009395:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff933386711880. 00000100:00100000:0.0:1788619951.009433:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788619951.009442:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657039616:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:0.0:1788619951.009706:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788619951.009709:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788619948 -> 1788619951 00002000:00010000:0.0:1788619951.009712:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788619946 -> 1788619946 00002000:00010000:0.0:1788619951.009715:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788619948 -> 1788619951 00002000:00010000:0.0:1788619951.009717:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788619951.009944:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657039616:12345-192.168.203.12@tcp:10:bash.0 Request processed in 502us (720us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788619951.009952:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:0.0:1788619951.009955:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788619951.009958:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933386711880 with x1875503657039616 ext(0->18446744073709551615) 00002000:00010000:0.0:1788619951.009963:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff933386711880. 00000100:00100000:1.0:1788619951.086564:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.086681:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657039744 00000100:00100000:0.0:1788619951.086691:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657039744 00000100:00100000:0.0:1788619951.086971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1788619951.086983:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:10511:x1875503657039744:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788619951.087052:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087081:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087094:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087112:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087118:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087125:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087351:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087360:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087368:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619951.087405:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087417:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087423:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087442:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087448:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.087452:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087461:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087472:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619951.087476:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.087480:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087486:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087500:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087506:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087512:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087517:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.087519:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087535:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087543:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93338385a800) 00010000:00010000:0.0:1788619951.087545:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.087548:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087553:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087568:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087574:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087580:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087585:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.087587:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087594:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087601:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.087603:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.087606:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.087621:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.088014:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:10511:x1875503657039744:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 760us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.088023:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788619951.142457:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.142547:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657040000 00000100:00100000:0.0:1788619951.142558:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657040000 00000100:00100000:0.0:1788619951.142614:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:0.0:1788619951.142632:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+27:10514:x1875503657040000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619951.142650:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.142676:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe72e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9e8 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142801:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142823:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142835:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142857:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142865:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.142885:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143141:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143150:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143163:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619951.143172:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788619951.143275:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143283:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143291:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143297:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.143301:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143315:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143327:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619951.143330:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.143345:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143351:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143363:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143370:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143376:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143381:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.143384:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143389:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143396:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93338385a800) 00010000:00010000:0.0:1788619951.143399:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.143402:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143407:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe73c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143445:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe72e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e8 expref: 30 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143471:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e8 expref: 29 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.143478:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.143480:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788619951.143483:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788619951.143597:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+29:10514:x1875503657040000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 974us (1148us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788619951.143604:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1788619951.146187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619951.146286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657040128 00000100:00100000:1.0:1788619951.146307:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657040128 00000100:00100000:1.0:1788619951.146359:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788619951.146368:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:10514:x1875503657040128:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788619951.146432:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.146447:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.146456:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.146486:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.146499:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 29 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.146511:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676984576:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619951.146593:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619951.149097:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.149165:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657040384 00000100:00100000:0.0:1788619951.149173:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657040384 00000100:00100000:0.0:1788619951.149222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788619951.149231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+30:5595:x1875503657040384:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788619951.149537:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:5595:x1875503657040384:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 306us (447us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788619951.149545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788619951.150103:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676984576:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619951.150127:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.152845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619951.153039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657040512 00000100:00100000:1.0:1788619951.153048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657040512 00010000:00010000:1.0:1788619951.153083:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 31 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.153142:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788619951.153152:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:2354:x1875503657040512:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619951.153171:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619951.153178:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 31 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153190:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 31 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153211:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe6f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9d3 expref: 31 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153225:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:1.0:1788619951.153230:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153238:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153245:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.153286:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619951.153340:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+30:2354:x1875503657040512:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 190us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619951.153347:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:0.0:1788619951.154103:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154113:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154142:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154149:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154166:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154172:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.154176:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154184:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154194:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.154198:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619951.154202:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.154208:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbe751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.154280:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:10514:x1875503657040128:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 7911us (8099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.154288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1788619951.157558:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.157632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657040768 00000100:00100000:0.0:1788619951.157640:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657040768 00000100:00100000:0.0:1788619951.157694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788619951.157704:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+29:10514:x1875503657040768:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619951.158184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+30:10514:x1875503657040768:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 479us (648us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788619951.158192:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000040:00080000:3.0:1788619951.239297:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619951.239306:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788619951.239337:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788619951.239343:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619951.256172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.258547:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657041024 00000100:00100000:0.0:1788619951.258629:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657041024 00000100:00100000:0.0:1788619951.258799:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788619951.258811:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+30:10525:x1875503657041024:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788619951.258834:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.258854:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9ef expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258928:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258945:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258958:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258975:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258982:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.258987:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259266:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe76d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259276:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259295:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619951.259306:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788619951.259498:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259507:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259512:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259517:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.259521:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259528:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259539:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619951.259542:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.259546:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259551:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe75f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259632:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259639:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259651:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259656:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.259659:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259664:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259672:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93338385a800) 00010000:00010000:0.0:1788619951.259674:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.259677:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259682:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259724:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9ef expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259739:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe76d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9ef expref: 32 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.259746:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.259748:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619951.259750:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788619951.259996:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+32:10525:x1875503657041024:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1187us (3833us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788619951.260013:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788619951.268641:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.269170:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657041280 00000100:00100000:0.0:1788619951.269182:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657041280 00000100:00100000:1.0:1788619951.269473:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788619951.269496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+32:10525:x1875503657041280:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788619951.269739:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:10525:x1875503657041280:12345-192.168.203.12@tcp:35:cat.0 Request processed in 244us (1108us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788619951.270243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788619951.286062:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.287180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657041536 00000100:00100000:0.0:1788619951.287193:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657041536 00000100:00100000:0.0:1788619951.287281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788619951.287292:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:10526:x1875503657041536:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1788619951.287487:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788619951.287515:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe76d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9ef expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287540:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e8 expref: 32 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287553:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe70b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9da expref: 31 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287628:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9333838faf00) 00010000:00010000:0.0:1788619951.287639:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619951.287659:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287672:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287681:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287695:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287714:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.287720:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.294024:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.294044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.294055:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788619951.296221:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788619951.296234:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354264461060ns, next at 355264458288ns, rc = 0 00010000:00010000:1.0:1788619951.296313:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.296330:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.299445:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.299458:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.299465:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.299472:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.305797:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676984704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619951.305876:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619951.307680:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676984704 00000100:00100000:0.0:1788619951.307693:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676984704 00000100:00100000:0.0:1788619951.307760:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788619951.307797:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676984704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619951.307835:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619951.307908:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676984704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.307915:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:2.0:1788619951.307993:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788619951.308017:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619951.308024:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308033:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619951.308038:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308047:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308071:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933390117b00) 00010000:00010000:2.0:1788619951.308074:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788619951.308080:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308085:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619951.308118:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619951.308119:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619951.308149:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308156:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308162:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308166:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.308169:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308174:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308182:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933390117b00) 00010000:00010000:2.0:1788619951.308185:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788619951.308188:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308194:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe789 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308217:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308224:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308236:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308240:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.308243:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308248:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308268:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619951.308270:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.308273:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.308277:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe77b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619951.308288:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e17e4d95 reply state 00000000bbf0fa5d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.308296:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619951.309384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+32:10526:x1875503657041536:12345-192.168.203.12@tcp:36:rm.0 Request processed in 22086us (23330us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788619951.309394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788619951.311319:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676984704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788619951.315512:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315530:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315549:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315555:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619951.315618:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315625:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315640:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93338385a800) 00010000:00010000:3.0:1788619951.315642:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619951.315647:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.315653:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbe782 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.380675:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.383722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657041792 00000100:00100000:3.0:1788619951.383736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657041792 00000100:00100000:3.0:1788619951.383901:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788619951.383912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:10532:x1875503657041792:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619951.383936:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619951.383955:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe797 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9f6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384079:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384094:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384106:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384120:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.384135:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788619951.390082:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788619951.390306:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390347:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390385:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390393:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390409:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390415:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619951.390419:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390426:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390438:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:1.0:1788619951.390451:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619951.390456:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390462:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbe79e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619951.390477:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af035733 reply state 0000000041c22b3f transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.390486:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788619951.390521:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbe797 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390535:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.390543:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:1.0:1788619951.390546:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619951.390548:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142c00, rc 0) 00000100:00100000:1.0:1788619951.390963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+34:10532:x1875503657041792:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7052us (10297us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788619951.390972:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00010000:00010000:3.0:1788619951.393872:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.393889:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.393897:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.393904:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619951.393909:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.393935:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.394014:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933388291700) 00010000:00010000:3.0:1788619951.394018:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619951.394023:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.394029:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbe7a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.394410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.394512:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657041920 00000100:00100000:3.0:1788619951.394521:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657041920 00000100:00100000:3.0:1788619951.394682:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788619951.394693:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657041920:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619951.394711:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619951.394729:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06a9fd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619951.394754:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788619951.394798:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1788619951.394803:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619951.394812:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.394830:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.394859:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31400, rc 0) 00000100:00100000:3.0:1788619951.394915:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657041920:12345-192.168.203.12@tcp:101:bash.0 Request processed in 224us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.394923:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00080000:1.0:1788619951.395018:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788619951.396996:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788619951.397095:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788619951.398696:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.398825:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657042048 00000100:00100000:3.0:1788619951.398836:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657042048 00000100:00100000:0.0:1788619951.398932:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788619951.398942:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:10532:x1875503657042048:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619951.398959:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.398977:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa04 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.399010:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.399020:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619951.399031:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619951.399037:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.399068:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.399078:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 7 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.399088:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676984832:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619951.399188:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619951.408666:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.408921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657042176 00000100:00100000:2.0:1788619951.408930:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657042176 00010000:00010000:2.0:1788619951.408973:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.409027:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788619951.409037:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387307c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657042176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619951.409051:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619951.409072:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.409086:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.409215:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619951.409221:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619951.409230:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.409241:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.409298:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.409313:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc463480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875503676984960:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788619951.409390:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390540 going to sleep for 11 seconds 00010000:00010000:0.0:1788619951.409984:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbe7ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9fd expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.410002:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676984832:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619951.410028:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.410039:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3600, rc 0) 00000100:00100000:0.0:1788619951.410074:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:10532:x1875503657042048:12345-192.168.203.12@tcp:101:bash.0 Request processed in 11133us (11384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.410081:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788619951.415988:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc463480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875503676984960:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788619951.416031:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619951.416182:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387307c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657042176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 7144us (7524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.416192:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788619951.417262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.417940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657042432 00000100:00100000:2.0:1788619951.417953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657042432 00000100:00100000:2.0:1788619951.418114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788619951.418128:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:10532:x1875503657042432:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788619951.419128:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+34:10532:x1875503657042432:12345-192.168.203.12@tcp:35:bash.0 Request processed in 996us (1881us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788619951.419140:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788619951.553210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.553349:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657042560 00000100:00100000:0.0:1788619951.553363:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657042560 00000100:00100000:0.0:1788619951.553456:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1788619951.553494:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+34:10548:x1875503657042560:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619951.553529:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.553564:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe7c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa0b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553664:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553683:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553698:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619951.553749:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788619951.553754:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619951.553823:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe7c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa0b expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553878:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa0b expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.553889:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619951.553892:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619951.553896:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788619951.553974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:10548:x1875503657042560:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 485us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.553995:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00010000:00010000:2.0:1788619951.559040:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619951.566179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.566338:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657042816 00000100:00100000:2.0:1788619951.566354:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657042816 00000100:00100000:2.0:1788619951.566427:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788619951.566439:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+35:10548:x1875503657042816:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619951.566467:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619951.566494:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe7d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa12 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.566645:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe7dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.566663:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.566677:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619951.566704:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788619951.566931:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe7d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa12 expref: 38 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.566954:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe7dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa12 expref: 37 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.566964:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:2.0:1788619951.566967:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619951.566971:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eae00, rc 0) 00000100:00100000:2.0:1788619951.567059:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+37:10548:x1875503657042816:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 623us (895us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788619951.567068:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788619951.572541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619951.572588:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.572720:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043200 00000100:00100000:3.0:1788619951.572734:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043200 00000100:00100000:0.0:1788619951.572737:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043072 00000100:00100000:0.0:1788619951.572745:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043072 00000100:00100000:0.0:1788619951.572824:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1788619951.572838:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+38:10548:x1875503657043072:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619951.572871:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.572900:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe7eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa19 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.573030:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.573050:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.573065:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619951.573081:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:3.0:1788619951.573108:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788619951.573118:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+39:2355:x1875503657043200:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619951.573130:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619951.573153:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe7dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa12 expref: 39 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.573175:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:3.0:1788619951.573182:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619951.573265:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+39:2355:x1875503657043200:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 148us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.573273:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00010000:00010000:0.0:1788619951.573340:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe7eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa19 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.573361:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa19 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.573369:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:0.0:1788619951.573372:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788619951.573375:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788619951.573414:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+38:10548:x1875503657043072:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 580us (891us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788619951.573421:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1788619951.578704:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.579005:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043328 00000100:00100000:3.0:1788619951.579019:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043328 00000100:00100000:3.0:1788619951.579126:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788619951.579138:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657043328:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1788619951.579202:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.579266:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.579278:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619951.579283:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619951.579290:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.579348:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.579365:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 6 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.579383:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875503676985088:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619951.579506:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619951.581870:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875503676985088:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619951.581914:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.583972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.584221:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043456 00000100:00100000:3.0:1788619951.584235:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043456 00002000:00100000:3.0:1788619951.584318:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9333bd28aa00 x1875503657043456/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:47/0 lens 504/0 e 0 to 0 dl 1788619962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619951.584354:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd28aa00 with x1875503657043456 ext(0->8) 00010000:00010000:3.0:1788619951.584367:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 7 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.584396:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 7 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619951.584405:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bd28aa00 00000100:00100000:3.0:1788619951.584478:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788619951.584491:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657043456:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788619951.585187:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657043456:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 693us (1224us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788619951.585198:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00100000:3.0:1788619951.585208:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9333bd28aa00 x1875503657043456/t4294967302(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:47/0 lens 504/448 e 0 to 0 dl 1788619962 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619951.585217:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd28aa00 with x1875503657043456 ext(0->8) 00010000:00010000:3.0:1788619951.585224:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.585240:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619951.585257:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bd28aa00 00000100:00100000:2.0:1788619951.588644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.588923:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043584 00000100:00100000:3.0:1788619951.588954:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043584 00010000:00010000:3.0:1788619951.589007:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.589054:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788619951.589066:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657043584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619951.589086:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788619951.589110:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788619951.589114:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788619952 00002000:00010000:3.0:1788619951.589116:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788619952 00002000:00010000:3.0:1788619951.589118:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788619952 00010000:00010000:3.0:1788619951.589125:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.589141:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.589168:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbe7c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa04 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.589186:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619951.589191:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619951.589198:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.589209:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.589271:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619951.589404:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657043584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 271us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.589415:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00010000:00010000:2.0:1788619951.589925:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.589940:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.589972:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.589981:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.590004:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.590011:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619951.590015:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.590025:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.590043:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.590052:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abecbf80/0xbb0e330328bbe800 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.590182:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657043328:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 11043us (11491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.590192:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788619951.593272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.593392:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043840 00000100:00100000:0.0:1788619951.593406:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043840 00000100:00100000:0.0:1788619951.593477:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788619951.593490:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+38:10548:x1875503657043840:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1788619951.593582:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa19 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619951.593976:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788619951.594010:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788619951.594344:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788619951.594411:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.594432:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.594443:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.594489:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.594513:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 42 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.594529:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676985216:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619951.594662:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619951.600239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.600324:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657043968 00000100:00100000:2.0:1788619951.600337:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657043968 00010000:00010000:2.0:1788619951.600383:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 43 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.600446:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788619951.600458:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+43:2354:x1875503657043968:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619951.600478:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619951.600487:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 43 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.600502:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 43 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.600535:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:2.0:1788619951.600542:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.600555:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.600558:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbe7ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9f6 expref: 43 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.600567:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.600584:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676985216:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619951.600595:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619951.600616:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.600629:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.600635:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.600669:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+42:2354:x1875503657043968:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 212us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.600804:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000001:00080000:0.0:1788619951.600845:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788619951.601116:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788619951.601283:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676985344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788619951.601342:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619951.601381:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788619951.601449:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676985344 00000100:00100000:2.0:1788619951.601456:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676985344 00000100:00100000:2.0:1788619951.601502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788619951.601512:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676985344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788619951.601610:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676985344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.601618:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788619951.601736:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788619951.601743:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788619951.601764:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bd247100, transno 4294967301 00000100:00100000:0.0:1788619951.601815:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676985344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619951.602340:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788619951.602418:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676985472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788619951.602461:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619951.602484:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619951.602967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676985472 00000100:00100000:1.0:1788619951.602976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676985472 00000100:00100000:1.0:1788619951.603035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788619951.603044:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676985472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788619951.603243:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875503676985472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 200us (781us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788619951.603260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788619951.603440:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676985472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619951.603523:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788619951.603575:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603587:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603595:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603602:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.603608:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603617:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603637:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:0.0:1788619951.603640:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788619951.603646:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.603654:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe807 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619951.603964:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788619951.604069:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788619951.604082:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354572309636ns, next at 355572307218ns, rc = 0 00000001:00080000:0.0:1788619951.604090:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788619951.604126:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117e00) 00010000:00010000:0.0:1788619951.604130:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788619951.604148:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe7f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa19 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.604283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+45:10548:x1875503657043840:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 10795us (11038us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788619951.604293:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000020:00080000:0.0:1788619951.604298:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788619951.606634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.606705:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657044096 00000100:00100000:2.0:1788619951.606719:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657044096 00000100:00100000:1.0:1788619951.607096:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788619951.607112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+45:10548:x1875503657044096:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619951.607148:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619951.607177:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe80e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa20 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.607269:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe80e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa20 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.607287:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe80e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa20 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619951.607309:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:1.0:1788619951.607313:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788619951.607336:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142000, rc 0) 00000100:00100000:1.0:1788619951.608221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+46:10548:x1875503657044096:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1105us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619951.608234:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788619951.610203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.610351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657044352 00000100:00100000:2.0:1788619951.610363:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657044352 00000100:00100000:2.0:1788619951.610478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788619951.610491:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+46:10548:x1875503657044352:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619951.610848:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+47:10548:x1875503657044352:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 358us (656us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788619951.610857:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788619951.693709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.693991:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657044480 00000100:00100000:0.0:1788619951.694004:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657044480 00000100:00100000:0.0:1788619951.694153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1788619951.694167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+47:10558:x1875503657044480:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788619951.694286:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694307:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694321:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694338:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694346:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694354:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694559:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694591:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694600:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619951.694657:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694672:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694680:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694688:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694694:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.694699:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694708:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694722:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619951.694726:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.694732:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694740:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe815 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694764:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.694998:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695007:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695013:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.695015:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695022:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695032:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93338385a900) 00010000:00010000:0.0:1788619951.695035:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.695038:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695045:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe81c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695062:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695068:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695074:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695087:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.695091:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695097:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695106:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619951.695108:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619951.695112:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.695118:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.695229:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+47:10558:x1875503657044480:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1061us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.695237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1788619951.770556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.771266:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657044736 00000100:00100000:2.0:1788619951.771282:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657044736 00000100:00100000:2.0:1788619951.771413:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:2.0:1788619951.771425:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+47:10561:x1875503657044736:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619951.771451:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619951.771479:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe82a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa27 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771592:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771611:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771625:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771662:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771670:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.771676:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773308:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773332:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773356:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619951.773373:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788619951.773506:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773514:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773521:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773528:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.773533:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773563:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773592:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619951.773596:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.773602:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773610:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773629:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773636:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773642:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773647:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.773650:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773656:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773664:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fa500) 00010000:00010000:2.0:1788619951.773667:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.773671:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.773687:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.775587:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe82a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 50 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.775629:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 49 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.775640:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619951.775643:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619951.775647:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619951.776257:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+49:10561:x1875503657044736:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4822us (5702us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788619951.776270:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1788619951.780397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.780580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657044864 00000100:00100000:0.0:1788619951.780593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657044864 00000100:00100000:0.0:1788619951.780666:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788619951.780679:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+49:10561:x1875503657044864:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788619951.780818:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780840:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780856:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780903:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780912:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780920:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780927:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619951.780932:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780942:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780956:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619951.780960:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619951.780965:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.780972:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe84d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.781062:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+49:10561:x1875503657044864:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 386us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.781071:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1788619951.785602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.785710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657045120 00000100:00100000:0.0:1788619951.785723:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657045120 00000100:00100000:0.0:1788619951.787620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788619951.787669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+49:10561:x1875503657045120:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619951.788031:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+50:10561:x1875503657045120:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 372us (2444us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788619951.788040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788619951.870872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.871021:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657045376 00000100:00100000:2.0:1788619951.871036:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657045376 00000100:00100000:2.0:1788619951.871113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1788619951.871126:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+50:10571:x1875503657045376:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619951.871158:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619951.871162:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788619951.871198:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe7cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa0b expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871222:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619951.871229:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619951.871278:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa2e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871423:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871441:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 50 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871451:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871490:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 50 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.871508:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 50 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619951.871524:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc462680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676985600:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619951.871695:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390000 going to sleep for 11 seconds 00000100:00100000:1.0:1788619951.881629:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.881929:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc462680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676985600:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619951.881969:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.885189:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657045504 00000100:00100000:3.0:1788619951.885212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657045504 00010000:00010000:3.0:1788619951.885295:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 51 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.885366:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788619951.885379:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+51:2354:x1875503657045504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619951.885408:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619951.885417:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 51 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885434:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 51 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885463:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbe83f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa27 expref: 51 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885490:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619951.885495:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885508:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885536:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.885583:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619951.885683:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+50:2354:x1875503657045504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 306us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.885691:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00010000:00010000:2.0:1788619951.885734:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.885746:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619951.885817:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788619951.886028:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.886045:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.886053:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619951.886056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788619951.886058:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:2.0:1788619951.886096:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+50:10571:x1875503657045376:12345-192.168.203.12@tcp:101:bash.0 Request processed in 14973us (15242us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788619951.886104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1788619951.896632:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.896752:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657045760 00000100:00100000:0.0:1788619951.896765:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657045760 00000100:00100000:0.0:1788619951.896884:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1788619951.896896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+50:10571:x1875503657045760:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788619951.897263:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.897286:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.897300:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619951.897645:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788619951.897685:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7be831c reply state 00000000948ac4e0 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.897696:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788619951.897886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+53:10571:x1875503657045760:12345-192.168.203.12@tcp:36:bash.0 Request processed in 988us (1276us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788619951.897895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000020:00080000:0.0:1788619951.897901:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788619951.906853:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906879:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906887:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906895:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619951.906901:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906911:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906975:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619951.906980:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619951.906986:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.906994:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.907154:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619951.907257:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657045888 00000100:00100000:0.0:1788619951.907271:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657045888 00000100:00100000:0.0:1788619951.907350:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1788619951.907369:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+52:10571:x1875503657045888:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619951.907398:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619951.907420:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe870 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa35 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.907529:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.907546:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.907556:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.907752:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.907768:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 53 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619951.907894:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676985728:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619951.908044:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788619951.914043:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676985728:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619951.914086:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619951.914871:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.915290:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046016 00000100:00100000:3.0:1788619951.915301:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046016 00010000:00010000:3.0:1788619951.915358:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 54 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.915453:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788619951.915467:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+54:2354:x1875503657046016:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619951.915487:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619951.915495:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 54 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915511:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 54 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915539:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe85b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa2e expref: 54 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915558:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619951.915564:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915576:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915585:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.915628:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619951.915717:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+53:2354:x1875503657046016:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 253us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619951.915726:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:0.0:1788619951.915940:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.915950:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619951.916010:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788619951.916023:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619951.916052:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.916091:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe870 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 53 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.916107:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 52 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619951.916115:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619951.916118:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619951.916121:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788619951.916168:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+52:10571:x1875503657045888:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8802us (9021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619951.916175:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:1.0:1788619951.918976:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.919147:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046272 00000100:00100000:2.0:1788619951.919162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046272 00000100:00100000:2.0:1788619951.919275:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788619951.919287:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+52:10571:x1875503657046272:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788619951.919654:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+53:10571:x1875503657046272:12345-192.168.203.12@tcp:35:bash.0 Request processed in 367us (691us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788619951.919662:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788619951.980275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.980390:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046400 00000100:00100000:2.0:1788619951.980435:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046400 00000100:00100000:2.0:1788619951.980515:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1788619951.980528:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+53:10577:x1875503657046400:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619951.980558:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619951.980585:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe87e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa3c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.980671:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.980688:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.980702:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619951.980758:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788619951.980762:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619951.980965:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.980996:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe87e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa3c expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.981016:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa3c expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.981025:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619951.981028:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619951.981032:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:2.0:1788619951.981118:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657046400:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 592us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.981125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:1.0:1788619951.985286:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.985512:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046528 00000100:00100000:2.0:1788619951.985525:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046528 00000100:00100000:2.0:1788619951.986816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:2.0:1788619951.986837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657046528:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619951.986865:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619951.986895:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe88c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa43 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987152:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987171:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987186:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987204:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987211:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987217:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987347:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987376:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987384:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619951.987443:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788619951.987448:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619951.987471:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987485:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987494:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987501:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987509:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987515:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eaa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.987520:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987529:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987543:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:2.0:1788619951.987547:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.987560:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987568:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987598:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987604:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987611:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987617:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619951.987620:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987625:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987634:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9333838fa500) 00010000:00010000:2.0:1788619951.987636:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619951.987640:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987645:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbe89a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987684:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe88c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa43 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987711:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa43 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.987719:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619951.987721:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619951.987724:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:2.0:1788619951.988416:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+55:10577:x1875503657046528:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1580us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.988427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788619951.994524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619951.994675:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046656 00000100:00100000:2.0:1788619951.994688:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046656 00000100:00100000:2.0:1788619951.994886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788619951.994908:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:2355:x1875503657046656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619951.994929:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619951.994970:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe8a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa43 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619951.994992:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619951.994999:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619951.995073:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+54:2355:x1875503657046656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 176us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619951.995081:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788619951.996420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619951.996567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657046912 00000100:00100000:3.0:1788619951.996579:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657046912 00000100:00100000:3.0:1788619951.996647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788619951.996659:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657046912:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619951.996684:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619951.996710:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe8a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.996883:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.996909:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 55 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.996919:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.996967:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 55 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619951.996982:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 55 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619951.996998:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676985856:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619951.997121:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619952.001419:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676985856:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619952.001466:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.002983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.003150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047040 00000100:00100000:2.0:1788619952.003163:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047040 00010000:00010000:2.0:1788619952.003220:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 56 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.003303:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788619952.003315:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387305050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+56:2354:x1875503657047040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619952.003356:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619952.003954:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 56 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.003974:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 56 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.004006:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa35 expref: 56 pid: 8707 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.004026:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619952.004033:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.004044:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.004053:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.004088:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619952.004128:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.004140:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619952.004171:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1788619952.004182:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387305050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:2354:x1875503657047040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 868us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.004194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00010000:00010000:0.0:1788619952.005740:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31c00/0xbb0e330328bbe8a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.005793:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.005804:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619952.005808:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619952.005812:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31400, rc 0) 00000100:00100000:0.0:1788619952.005887:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:10577:x1875503657046912:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 9231us (9485us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788619952.005896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788619952.015283:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.015463:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047296 00000100:00100000:3.0:1788619952.015477:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047296 00000100:00100000:3.0:1788619952.015596:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788619952.015609:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+55:10577:x1875503657047296:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:3.0:1788619952.015630:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619952.015663:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe80e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa20 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.015689:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619952.015695:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619952.016190:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657047296:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 581us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.016200:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788619952.019306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.019410:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047424 00000100:00100000:0.0:1788619952.019424:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047424 00000100:00100000:0.0:1788619952.019503:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1788619952.019516:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657047424:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:0.0:1788619952.019656:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.019679:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.019693:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788619952.020191:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788619952.020459:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657047424:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 942us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.020471:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:1.0:1788619952.024164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.024367:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047552 00000100:00100000:0.0:1788619952.024380:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047552 00000100:00100000:0.0:1788619952.024541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:0.0:1788619952.024560:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+54:10577:x1875503657047552:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619952.024591:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619952.024615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa51 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.024977:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.024992:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.025021:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.025037:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.025050:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619952.025052:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619952.025056:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.025063:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3200, rc 0) 00000100:00100000:0.0:1788619952.025348:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+55:10577:x1875503657047552:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 794us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.025356:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000040:00080000:3.0:1788619952.263502:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619952.263514:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788619952.263580:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788619952.263589:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619952.263761:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676985984:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788619952.265199:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788619952.269311:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676985984:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788619952.272161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.272368:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047680 00000100:00100000:1.0:1788619952.272382:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047680 00000100:00100000:1.0:1788619952.272463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788619952.272477:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+55:10578:x1875503657047680:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788619952.272522:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788619952.272655:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+55:10578:x1875503657047680:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 181us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619952.272664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788619952.289942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.290347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657047808 00000100:00100000:3.0:1788619952.290362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657047808 00000100:00100000:3.0:1788619952.290443:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1788619952.290455:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:10578:x1875503657047808:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788619952.290568:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290590:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290608:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290626:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290634:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290640:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290671:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290681:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290688:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619952.290737:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788619952.290744:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619952.290760:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290823:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290839:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290847:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290854:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.290859:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290868:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290883:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:3.0:1788619952.290887:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.290892:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290909:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe8cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290927:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290933:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290939:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290945:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.290955:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290961:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290969:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff933388291700) 00010000:00010000:3.0:1788619952.290972:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.290975:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.290982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe8d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291007:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291014:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291020:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291025:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.291028:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291033:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291040:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619952.291043:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.291067:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.291074:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe8d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.291182:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:10578:x1875503657047808:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 728us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.291193:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:2.0:1788619952.298448:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.298557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657048064 00000100:00100000:1.0:1788619952.298571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657048064 00000100:00100000:1.0:1788619952.298637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1788619952.298648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+55:10578:x1875503657048064:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619952.298674:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619952.298701:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe8e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa58 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.298868:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.298886:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299176:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619952.299194:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788619952.299339:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299346:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299353:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619952.299364:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299373:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299405:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:1.0:1788619952.299408:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788619952.299413:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299477:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe8e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa58 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299489:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:1.0:1788619952.299492:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788619952.299495:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe8e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa58 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.299505:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143600, rc 0) 00000100:00100000:1.0:1788619952.299590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048064:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 944us (1157us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788619952.299600:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788619952.308382:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.308580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657048192 00000100:00100000:3.0:1788619952.308595:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657048192 00000100:00100000:3.0:1788619952.308720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788619952.308731:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048192:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788619952.308827:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788619952.309017:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048192:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 287us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.309027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1788619952.315418:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.315667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657048448 00000100:00100000:1.0:1788619952.315683:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657048448 00000100:00100000:1.0:1788619952.315854:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:1.0:1788619952.315868:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048448:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619952.315974:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619952.315979:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788619952.316025:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa3c expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.316077:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:1.0:1788619952.316084:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619952.316105:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe8f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa5f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788619952.316635:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788619952.330966:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.330993:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.331006:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.331114:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbe8f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa5f expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.331137:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa5f expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.331147:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff933390117100) 00010000:00010000:1.0:1788619952.331150:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619952.331154:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142000, rc 0) 00000100:00100000:1.0:1788619952.331238:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+57:10578:x1875503657048448:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 15372us (15839us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788619952.331258:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1788619952.342253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.342360:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657048704 00000100:00100000:0.0:1788619952.342370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657048704 00000100:00100000:0.0:1788619952.342429:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788619952.342440:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+57:10578:x1875503657048704:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788619952.342497:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619952.342523:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbe8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa5f expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342543:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff933390117100) 00010000:00010000:0.0:1788619952.342554:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619952.342575:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342589:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342599:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342614:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342620:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342627:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342689:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342713:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342719:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342724:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.342729:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342736:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342744:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619952.342759:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619952.342764:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342829:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe90a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342841:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342847:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342853:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342858:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.342867:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342874:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342882:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8c54e3ce (ffff93338385ae00) 00010000:00010000:0.0:1788619952.342885:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619952.342888:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.342893:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbe911 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8c54e3ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.342964:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048704:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 526us (731us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788619952.342971:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788619952.350223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.350392:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657048832 00000100:00100000:0.0:1788619952.350402:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657048832 00000100:00100000:0.0:1788619952.350455:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1788619952.350465:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+56:10578:x1875503657048832:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619952.350486:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619952.350512:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe918 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa66 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350549:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350563:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350592:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350684:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 58 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350703:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 57 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.350713:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788619952.350716:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788619952.350720:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788619952.351100:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+57:10578:x1875503657048832:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 634us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.351107:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788619952.362703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.362857:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049088 00000100:00100000:3.0:1788619952.362876:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049088 00000100:00100000:3.0:1788619952.362959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788619952.362974:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+57:10578:x1875503657049088:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788619952.363094:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.363118:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.363131:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788619952.364122:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788619952.364139:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355332366110ns, next at 356332363096ns, rc = 0 00000004:00010000:3.0:1788619952.364280:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c50df39 reply state 0000000088c7ff38 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.364291:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619952.364455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+59:10578:x1875503657049088:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1481us (1757us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788619952.364465:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00010000:00010000:3.0:1788619952.368097:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368116:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368124:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368130:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.368135:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368143:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368160:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788619952.368164:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788619952.368169:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.368192:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbe926 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.370613:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.371088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049216 00000100:00100000:2.0:1788619952.371105:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049216 00000100:00100000:2.0:1788619952.371180:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1788619952.371190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+58:10578:x1875503657049216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619952.371215:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619952.371237:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa6d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.371309:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.371324:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.371346:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:2.0:1788619952.371349:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788619952.371353:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:2.0:1788619952.371427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+59:10578:x1875503657049216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 237us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.371436:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1788619952.377926:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.378493:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049344 00000100:00100000:0.0:1788619952.378508:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049344 00000100:00100000:0.0:1788619952.378583:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788619952.378594:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657049344:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788619952.378955:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657049344:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 362us (1044us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788619952.378963:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788619952.391364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.393786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049600 00000100:00100000:0.0:1788619952.393814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049600 00000100:00100000:0.0:1788619952.393996:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788619952.394009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+59:10578:x1875503657049600:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788619952.394375:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+60:10578:x1875503657049600:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 367us (3023us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788619952.394384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788619952.402363:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.402705:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049856 00000100:00100000:2.0:1788619952.402718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049856 00000100:00100000:2.0:1788619952.402839:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1788619952.402869:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+60:10578:x1875503657049856:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788619952.403021:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+60:10578:x1875503657049856:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 155us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.403029:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1788619952.408187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.408429:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657049984 00000100:00100000:2.0:1788619952.408445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657049984 00000100:00100000:2.0:1788619952.408529:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1788619952.408542:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+60:10578:x1875503657049984:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619952.408573:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619952.408605:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408743:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408761:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408810:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619952.408860:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619952.408882:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408913:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa74 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408935:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa74 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.408953:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:2.0:1788619952.408956:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788619952.408962:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eaa00, rc 0) 00000100:00100000:2.0:1788619952.409037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+61:10578:x1875503657049984:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 497us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.409045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1788619952.417390:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.417901:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050112 00000100:00100000:2.0:1788619952.417916:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050112 00000100:00100000:2.0:1788619952.417996:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788619952.418009:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657050112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619952.418032:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619952.418060:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa7b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619952.418108:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2cb1, blocks: 0x1 00010000:00010000:2.0:1788619952.418138:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1788619952.418143:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619952.418155:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.418179:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.418196:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb600, rc 0) 00000100:00100000:2.0:1788619952.418297:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+10:2355:x1875503657050112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 291us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.418305:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788619952.435603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.435728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050368 00000100:00100000:2.0:1788619952.435746:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050368 00000100:00100000:3.0:1788619952.435956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788619952.435975:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+61:10578:x1875503657050368:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788619952.436121:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+61:10578:x1875503657050368:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 152us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.436130:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788619952.444919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.445119:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050496 00000100:00100000:0.0:1788619952.445133:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050496 00000100:00100000:0.0:1788619952.445213:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788619952.445226:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+10:10578:x1875503657050496:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619952.445261:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619952.445288:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa82 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.445341:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.445352:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619952.445358:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619952.445364:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.445406:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.445422:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.445466:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1875503676986112:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619952.445584:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619952.449679:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1875503676986112:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619952.449733:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.449764:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788619952.449869:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+11:10578:x1875503657050496:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4644us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.449881:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1788619952.450165:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.453556:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050624 00000100:00100000:2.0:1788619952.453576:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050624 00010000:00010000:2.0:1788619952.453642:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.453713:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788619952.453724:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+11:2355:x1875503657050624:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619952.453745:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619952.453821:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.453839:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.453870:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d0bd48/0xbb0e330328bbe942 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa7b expref: 11 pid: 6691 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.453891:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619952.453897:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619952.453907:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.453944:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.453999:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.454019:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc462d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875503676986240:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788619952.454143:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390300 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.465085:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc462d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875503676986240:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788619952.465124:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619952.465201:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+10:2355:x1875503657050624:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 11477us (15036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619952.465215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788619952.474980:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.475055:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050752 00000100:00100000:0.0:1788619952.475068:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050752 00002000:00100000:0.0:1788619952.475131:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9333bc477b80 x1875503657050752/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:48/0 lens 504/0 e 0 to 0 dl 1788619963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788619952.475140:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc477b80 with x1875503657050752 ext(0->12) 00002000:00010000:0.0:1788619952.475229:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc477b80 00000100:00100000:0.0:1788619952.475339:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788619952.475351:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+10:2354:x1875503657050752:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788619952.476069:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:2354:x1875503657050752:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 715us (2307us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788619952.476080:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:0.0:1788619952.476090:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9333bc477b80 x1875503657050752/t4294967308(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:48/0 lens 504/448 e 0 to 0 dl 1788619963 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788619952.476107:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc477b80 with x1875503657050752 ext(0->12) 00002000:00010000:0.0:1788619952.476112:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc477b80 00000100:00100000:3.0:1788619952.478992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.481858:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657050880 00000100:00100000:1.0:1788619952.481879:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657050880 00000100:00100000:1.0:1788619952.481994:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788619952.482006:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+61:10578:x1875503657050880:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788619952.546021:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788619952.546057:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788619952.546080:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333908b9300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788619952.546086:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bd223e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333908b99c0 00000020:00080000:0.0:1788619952.546090:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bd223900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9333bd27b000 00000020:00080000:0.0:1788619952.546290:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788619952.546313:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676986368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788619952.546405:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619952.546509:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676986368 00000100:00100000:0.0:1788619952.546520:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676986368 00000100:00100000:0.0:1788619952.546599:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788619952.546611:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676986368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788619952.546649:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788619952.546694:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c2cb0, atime: 0x6a9c2cb0, ctime: 0x6a9c2cb0, blocks: 0x1 00010000:00010000:0.0:1788619952.546704:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.546725:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788619952.546730:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619952.546739:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.546758:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.546812:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.546821:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.546842:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788619952.547511:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676986368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 898us (1103us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788619952.547521:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788619952.547555:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788619952.547575:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619952.547582:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.547593:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619952.547600:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.547611:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.547633:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.547654:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f724eee/0xbb0e330328bbe950 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.547679:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619952.547681:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619952.547683:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788619952.547886:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bc6df100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788619952.547894:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676986368:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788619952.547945:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788619952.548081:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676986496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788619952.548127:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619952.548178:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676986496 00000100:00100000:0.0:1788619952.548185:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676986496 00000100:00100000:0.0:1788619952.548234:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788619952.548257:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676986496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788619952.548288:0:8933:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788619952.548311:0:8933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.548331:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.548340:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788619952.548344:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619952.548350:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.548387:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.548404:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 11 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.548419:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676986624:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619952.548498:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9a80 going to sleep for 11 seconds 00000100:00080000:0.0:1788619952.548514:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788619952.548577:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788619952.548601:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933387fcb600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788619952.548606:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933387f4de00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933387fcb300 00000020:00080000:0.0:1788619952.548609:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933387f4d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff933386705800 00000020:00080000:0.0:1788619952.548626:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788619952.548847:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788619952.548899:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676986752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788619952.548932:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619952.548968:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676986752 00000100:00100000:0.0:1788619952.548973:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676986752 00000100:00100000:0.0:1788619952.549002:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788619952.549010:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503676986752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788619952.549156:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788619952.549160:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788619953 00002000:00010000:0.0:1788619952.549163:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788619952.549173:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788619953 -> 1788619953 00002000:00010000:0.0:1788619952.549176:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788619952.549217:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1875503676986752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (282us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788619952.549225:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788619952.549889:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:10578:x1875503657050880:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 67880us (70909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.549907:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788619952.553577:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.553634:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.554292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051136 00000100:00100000:0.0:1788619952.554308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051136 00010000:00010000:0.0:1788619952.554373:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 12 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.554423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788619952.554435:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:2355:x1875503657051136:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619952.554454:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619952.554461:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 12 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.554479:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 12 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.554512:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619952.554518:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619952.554525:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.554537:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.554587:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619952.554661:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:2355:x1875503657051136:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 227us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.554669:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788619952.555127:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051008 00000100:00100000:0.0:1788619952.555134:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051008 00000100:00100000:0.0:1788619952.555169:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788619952.555176:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:2357:x1875503657051008:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788619952.557630:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bcb97b80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788619952.557651:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676986752:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788619952.558235:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbe712 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9e1 expref: 12 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.558273:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676986624:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619952.558303:0:8933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.558699:0:8933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.558712:0:8933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.558727:0:8933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.558736:0:8933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.558759:0:8933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788619952.558983:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619952.558993:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.559002:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619952.559007:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.559018:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.559134:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.559154:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b69bf49/0xbb0e330328bbe957 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.559176:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619952.559177:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619952.559179:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788619952.562393:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333909dbb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788619952.562462:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676986496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788619952.562504:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1875503676986496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14259us (14373us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788619952.562521:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788619952.583297:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788619952.592651:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788619952.592675:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788619952.592933:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657051008:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 37747us (39362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.592948:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788619952.597585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.597991:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051392 00000100:00100000:0.0:1788619952.598005:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051392 00000100:00100000:0.0:1788619952.598089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1788619952.598100:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+15:10578:x1875503657051392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788619952.598178:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619952.598214:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe93b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa74 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.598250:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788619952.598258:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619952.598297:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.598316:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.598329:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619952.599656:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b35d1e03 reply state 00000000e48d8fa9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.599673:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788619952.600029:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:10578:x1875503657051392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1925us (2454us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788619952.600098:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00010000:00010000:3.0:1788619952.603030:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.603116:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.603126:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.603134:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.603140:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.603151:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.603585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.603693:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051520 00000100:00100000:0.0:1788619952.603706:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051520 00000100:00100000:0.0:1788619952.603808:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788619952.603820:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657051520:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788619952.604112:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788619952.604117:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788619953 -> 1788619952 00002000:00010000:0.0:1788619952.604120:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788619952 00002000:00010000:0.0:1788619952.604122:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788619953 -> 1788619952 00002000:00010000:0.0:1788619952.604125:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788619952.604213:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657051520:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 395us (705us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788619952.604221:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:3.0:1788619952.604812:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788619952.604820:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.604831:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.604843:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe95e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.609160:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.609412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051776 00000100:00100000:2.0:1788619952.609445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051776 00000100:00100000:2.0:1788619952.609579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1788619952.609592:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+15:10578:x1875503657051776:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788619952.609691:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.609712:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 15 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.609722:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.609768:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 15 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.609815:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 15 pid: 8707 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.609833:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc463800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676986880:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619952.609960:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.613711:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc463800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676986880:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619952.613753:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.614061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.614309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657051904 00000100:00100000:3.0:1788619952.614319:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657051904 00010000:00010000:3.0:1788619952.614372:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 16 pid: 8707 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.614457:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788619952.614467:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:2355:x1875503657051904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619952.614487:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619952.614495:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 16 pid: 8707 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614514:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 16 pid: 8707 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614543:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbe91f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa66 expref: 16 pid: 8707 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614563:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788619952.614569:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614580:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614590:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.614614:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619952.614690:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:2355:x1875503657051904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 224us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.614698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00010000:00010000:1.0:1788619952.616149:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616204:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616571:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616582:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616591:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616599:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619952.616604:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616614:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616637:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:1.0:1788619952.616641:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788619952.616646:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.616653:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbe965 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.617366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:10578:x1875503657051776:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 7450us (7895us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788619952.617381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1788619952.619346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.619630:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052032 00000100:00100000:3.0:1788619952.619663:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052032 00000100:00100000:3.0:1788619952.619744:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788619952.619755:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2357:x1875503657052032:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788619952.619861:0:8933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.619887:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.619896:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619952.619902:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619952.619907:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.619952:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.619971:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 7 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.619988:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676987008:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619952.620263:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390c0c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.624032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619952.625006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052160 00000100:00100000:2.0:1788619952.625020:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052160 00010000:00010000:2.0:1788619952.625069:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 8 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619952.625109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788619952.625118:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657052160:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619952.625149:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619952.625170:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 8 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.625184:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 8 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.625215:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619952.625220:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619952.625228:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.625239:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.625272:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619952.625327:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657052160:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 210us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619952.625333:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00010000:00010000:0.0:1788619952.626898:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c93927d9/0xbb0e330328bbe949 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa82 expref: 7 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.626938:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676987008:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619952.626964:0:8933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.626976:0:8933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.626984:0:8933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627017:0:8933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627026:0:8933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627033:0:8933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627040:0:8933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619952.627043:0:8933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627051:0:8933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627073:0:8933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.627081:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a7a158/0xbb0e330328bbe96c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.627162:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657052032:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 7408us (7829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619952.627171:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788619952.631103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619952.631165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052416 00000100:00100000:0.0:1788619952.631183:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052416 00000100:00100000:0.0:1788619952.631269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1788619952.631281:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:10578:x1875503657052416:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788619952.631363:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.631381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.631395:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.634192:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.634219:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.634263:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.634305:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.634323:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 15 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.634338:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676987136:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619952.634430:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619952.641995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.642188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052544 00000100:00100000:3.0:1788619952.642201:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052544 00010000:00010000:3.0:1788619952.642268:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 16 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.642321:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788619952.642354:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:2355:x1875503657052544:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619952.642372:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619952.642379:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 16 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.642405:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 16 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.642435:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788619952.642441:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.642450:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.642459:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.642481:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619952.642552:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+16:2355:x1875503657052544:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 200us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.642560:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00010000:00010000:0.0:1788619952.642959:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbe92d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa6d expref: 15 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.642980:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676987136:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619952.643009:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.643018:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.643024:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619952.643584:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788619952.643758:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788619952.644260:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788619952.644410:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676987264:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788619952.644479:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619952.644514:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc58df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.646615:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676987264 00000100:00100000:1.0:1788619952.646640:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676987264 00000100:00100000:1.0:1788619952.646744:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788619952.646755:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676987264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619952.646940:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676987264:12345-0@lo:1000:mdt00_001.0 Request processed in 187us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619952.646949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788619952.646984:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788619952.646993:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788619952.647024:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bcb97b80, transno 4294967309 00000100:00100000:0.0:1788619952.647051:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9333909dbb80 x1875503676986496/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788619968 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788619952.647065:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676987264:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788619952.649859:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788619952.650034:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676987392:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788619952.650123:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619952.650172:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.650292:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676987392 00000100:00100000:1.0:1788619952.650302:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676987392 00000100:00100000:1.0:1788619952.650361:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788619952.650373:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676987392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619952.650694:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875503676987392:12345-0@lo:1000:mdt00_001.0 Request processed in 322us (571us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788619952.650705:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788619952.653500:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676987392:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788619952.653571:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653584:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653593:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653600:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.653605:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653614:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788619952.653661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619952.653668:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbe97a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653715:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653722:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653728:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653733:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.653736:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653742:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653749:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619952.653752:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619952.653761:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653898:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653916:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.653967:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619952.653986:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676987520:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788619952.654165:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf40e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619952.660455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.661216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052672 00000100:00100000:1.0:1788619952.661229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052672 00000100:00100000:1.0:1788619952.661325:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788619952.661336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:10577:x1875503657052672:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:1.0:1788619952.661523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:10577:x1875503657052672:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 188us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619952.661532:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788619952.664554:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676987520:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788619952.664604:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbe8bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664670:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664688:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664702:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664715:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664722:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664751:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664757:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.664762:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664798:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664813:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619952.664817:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619952.664821:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbe981 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664840:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664846:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664851:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664857:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619952.664859:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664878:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664887:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619952.664889:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788619952.664893:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619952.664899:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbe973 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788619952.665324:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619952.665331:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788619952.665455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+18:10578:x1875503657052416:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 34172us (34369us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788619952.665467:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000020:00080000:0.0:1788619952.665474:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788619952.666027:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788619952.666039:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788619952.666235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.666428:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657052928 00000100:00100000:3.0:1788619952.666439:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657052928 00000100:00100000:3.0:1788619952.666575:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788619952.666601:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:10577:x1875503657052928:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:3.0:1788619952.667038:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788619952.667127:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:10577:x1875503657052928:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 528us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.667137:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788619952.674440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.674649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657053184 00000100:00100000:3.0:1788619952.674663:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657053184 00000100:00100000:3.0:1788619952.674742:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788619952.674755:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:10578:x1875503657053184:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788619952.675599:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788619952.675722:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788619952.675825:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675863:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675875:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675883:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675891:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.675977:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788619952.676111:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:10578:x1875503657053184:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1354us (1682us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788619952.676122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000020:00080000:3.0:1788619952.676129:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788619952.679748:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788619952.679768:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.679822:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619952.679828:0:7635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.679841:0:7635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.679865:0:7635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff933388291700) 00010000:00010000:2.0:1788619952.679868:0:7635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788619952.679874:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.679882:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbe988 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619952.679917:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619952.679919:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619952.679921:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619952.699884:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.699993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657053312 00000100:00100000:1.0:1788619952.700009:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657053312 00000100:00100000:1.0:1788619952.700088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1788619952.700099:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:10580:x1875503657053312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619952.700133:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619952.700163:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe98f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa89 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700374:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700404:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700418:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700431:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700757:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700808:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700819:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700865:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.700893:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 21 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.700912:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc477800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676987648:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619952.701095:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619952.707751:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619952.708065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657053568 00000100:00100000:3.0:1788619952.708079:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657053568 00000100:00100000:3.0:1788619952.708154:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788619952.708166:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:5595:x1875503657053568:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788619952.708511:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:5595:x1875503657053568:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 345us (772us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788619952.708519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788619952.709414:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc477800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676987648:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619952.709453:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619952.711646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619952.712597:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657053696 00000100:00100000:1.0:1788619952.712618:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657053696 00010000:00010000:1.0:1788619952.712701:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 23 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.714084:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788619952.714114:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387304050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+23:2355:x1875503657053696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619952.714142:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619952.714156:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 23 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714175:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 23 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714204:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31400/0xbb0e330328bbe8af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa4a expref: 23 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714229:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:1.0:1788619952.714235:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714277:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714286:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619952.714419:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619952.714555:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.714566:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387304050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+22:2355:x1875503657053696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 464us (2932us total) trans 0 rc 0/0 00010000:00010000:3.0:1788619952.714569:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619952.714581:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000004:00200000:3.0:1788619952.714638:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788619952.714645:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619952.714673:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714690:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714701:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714710:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714739:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714747:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.714753:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714764:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714803:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:3.0:1788619952.714808:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.714812:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714819:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbe996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714832:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714839:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714845:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714850:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619952.714853:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714870:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714879:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933390117d00) 00010000:00010000:3.0:1788619952.714881:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619952.714885:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714891:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbe99d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714935:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbe98f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa89 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714951:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa89 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619952.714958:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619952.714960:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619952.714963:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142200, rc 0) 00000100:00100000:3.0:1788619952.714995:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+21:10580:x1875503657053312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 14898us (15129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619952.715003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000040:00080000:1.0:1788619953.539343:0:12120:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619953.539352:0:12120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619953.539397:0:12120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788619953.539404:0:12120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788619953.610500:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788619953.671019:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619953.671029:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788619953.671068:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788619953.671074:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619953.671294:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676987776:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788619953.671470:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390c0ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619953.676194:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619953.676205:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676987776:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788619953.676588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657053824 00000100:00100000:2.0:1788619953.676596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657053824 00000100:00080000:0.0:1788619953.676693:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619953.676739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788619953.676750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:10592:x1875503657053824:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788619953.676835:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788619953.676959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:10592:x1875503657053824:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 211us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619953.676967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788619953.695926:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619953.696014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054080 00000100:00100000:0.0:1788619953.696024:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054080 00000100:00100000:0.0:1788619953.696080:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788619953.696091:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:10592:x1875503657054080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619953.696127:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619953.696148:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe9ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa90 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619953.696499:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe9b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619953.696514:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619953.696525:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619953.696535:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788619953.697174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbe9ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa90 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619953.697192:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe9b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa90 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619953.697201:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619953.697204:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619953.697207:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2c00, rc 0) 00000100:00100000:0.0:1788619953.697468:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:10592:x1875503657054080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1549us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788619953.697476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788619953.702657:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619953.702741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054208 00000100:00100000:3.0:1788619953.702752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054208 00000100:00100000:3.0:1788619953.702944:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788619953.702956:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:2354:x1875503657054208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619953.702972:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619953.702996:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbe9b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa90 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619953.703015:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:3.0:1788619953.703020:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619953.703078:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:2354:x1875503657054208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 125us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619953.703086:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788619953.704750:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619953.704906:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054464 00000100:00100000:2.0:1788619953.704931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054464 00000100:00100000:2.0:1788619953.704979:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788619953.704988:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+22:10592:x1875503657054464:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788619953.705064:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705079:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705097:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705286:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705295:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705302:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705308:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619953.705312:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705320:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705332:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619953.705335:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788619953.705339:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619953.705355:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbe9c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619953.705511:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+23:10592:x1875503657054464:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 523us (764us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788619953.705519:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000040:00080000:0.0:1788619953.705694:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788619953.705699:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788619953.706247:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788619953.706256:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619953.708853:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619953.708971:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054720 00000100:00100000:3.0:1788619953.708980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054720 00000100:00100000:3.0:1788619953.709028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788619953.709038:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:10592:x1875503657054720:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788619953.709277:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:10592:x1875503657054720:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 239us (431us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788619953.709286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00010000:00010000:0.0:1788619954.631257:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619955.104341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619955.104378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619955.106476:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619955.106497:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619955.106518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619955.106546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054848 00000100:00100000:1.0:1788619955.106556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054848 00000100:00100000:1.0:1788619955.106602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:1.0:1788619955.106611:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657054848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619955.106676:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657054848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.106684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:1.0:1788619955.106717:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055360 00000100:00100000:1.0:1788619955.106731:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055360 00000100:00100000:1.0:1788619955.106768:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657054976 00000100:00100000:1.0:1788619955.106792:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657054976 00000100:00100000:1.0:1788619955.106817:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1788619955.106824:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657055360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619955.106856:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2355:x1875503657055360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.106862:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1788619955.106874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:1.0:1788619955.106880:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:2354:x1875503657054976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619955.106907:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:2354:x1875503657054976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.106914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:1.0:1788619955.106935:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055104 00000100:00100000:1.0:1788619955.106938:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055104 00000100:00100000:1.0:1788619955.106964:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055232 00000100:00100000:1.0:1788619955.106967:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055232 00000100:00100000:1.0:1788619955.106990:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788619955.106996:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657055104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619955.107021:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657055104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.107028:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788619955.107040:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788619955.107046:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657055232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619955.107069:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657055232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.107082:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00080000:1.0:1788619955.107217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619955.107222:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619955.107237:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788619955.376994:0:12172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619955.377005:0:12172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619955.377050:0:12172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788619955.377057:0:12172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788619955.399012:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676988160:0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399164:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619955.399219:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788619955.399238:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676988032:0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619955.399281:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676988544:0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619955.399342:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988160 00000100:00100000:2.0:1788619955.399349:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988160 00000100:00100000:2.0:1788619955.399400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988032 00000100:00100000:2.0:1788619955.399403:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988032 00000100:00100000:2.0:1788619955.399421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788619955.399429:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399478:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676988160:12345-0@lo:400:kworker.0 Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.399485:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788619955.399515:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788619955.399521:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399550:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676988032:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.399556:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788619955.399577:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988544 00000100:00100000:2.0:1788619955.399580:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988544 00000100:00100000:2.0:1788619955.399607:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788619955.399627:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399667:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676988544:12345-0@lo:400:kworker.0 Request processed in 54us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.399672:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788619955.399686:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619955.399690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619955.399723:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676988032:0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399733:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676988544:0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.399741:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676988160:0@lo:400:kworker.0 00000100:00100000:0.0:1788619955.399888:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676987904:0@lo:400:kworker.0 00000100:00100000:0.0:1788619955.399921:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619955.399949:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676988416:0@lo:400:kworker.0 00000100:00100000:0.0:1788619955.399966:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619955.399985:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619955.399990:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676988288:0@lo:400:kworker.0 00000100:00100000:1.0:1788619955.400113:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676987904 00000100:00100000:1.0:1788619955.400119:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676987904 00000100:00100000:1.0:1788619955.400146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788619955.400152:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619955.400186:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676987904:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.400192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788619955.400242:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619955.400278:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676987904:0@lo:400:kworker.0 00000100:00100000:1.0:1788619955.400322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988288 00000100:00100000:1.0:1788619955.400326:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988288 00000100:00100000:1.0:1788619955.400365:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788619955.400371:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619955.400403:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676988288:12345-0@lo:400:kworker.0 Request processed in 32us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619955.400408:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788619955.400433:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676988288:0@lo:400:kworker.0 00000100:00080000:0.0:1788619955.400646:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619955.401481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988416 00000100:00100000:2.0:1788619955.401489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988416 00000100:00100000:2.0:1788619955.401529:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788619955.401535:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933386713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619955.401583:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933386713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676988416:12345-0@lo:400:kworker.0 Request processed in 49us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.401589:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788619955.401847:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619955.401876:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676988416:0@lo:400:kworker.0 00000100:00100000:0.0:1788619955.627751:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619955.628033:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055616 00000100:00100000:2.0:1788619955.628043:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055616 00000100:00100000:2.0:1788619955.628136:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:2.0:1788619955.628146:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+24:10613:x1875503657055616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619955.628167:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619955.628187:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa97 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.628298:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe9ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.628313:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe9ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.628327:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe9ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619955.628338:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788619955.628633:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa97 expref: 27 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.628653:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe9ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa97 expref: 26 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.628662:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619955.628665:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788619955.628669:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eaa00, rc 0) 00000100:00100000:2.0:1788619955.628817:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+26:10613:x1875503657055616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 671us (1075us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788619955.628825:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:1.0:1788619955.635284:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619955.637877:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055744 00000100:00100000:2.0:1788619955.637910:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055744 00000100:00100000:2.0:1788619955.637975:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1788619955.637986:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:10613:x1875503657055744:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788619955.638056:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638086:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638098:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638123:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638129:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638136:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638142:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eae00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619955.638146:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638153:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638164:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:2.0:1788619955.638178:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619955.638424:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.638444:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eae00/0xbb0e330328bbe9dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619955.638529:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:10613:x1875503657055744:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 543us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.638537:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00010000:00010000:0.0:1788619955.655044:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619955.760814:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619955.761077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657055872 00000100:00100000:2.0:1788619955.761087:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657055872 00000100:00100000:2.0:1788619955.761147:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788619955.761157:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657055872:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788619955.761175:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619955.761195:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051fa963e/0xbb0e330328bbe9e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aa9e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619955.761231:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c2cb0, atime: 0x6a9c2cb0, ctime: 0x6a9c2cb0, blocks: 0xb 00010000:00010000:2.0:1788619955.761251:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788619955.761256:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619955.761267:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051fa963e/0xbb0e330328bbe9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa9e expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.761286:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051fa963e/0xbb0e330328bbe9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa9e expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619955.761300:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eae00, rc 0) 00000100:00100000:2.0:1788619955.761360:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657055872:12345-192.168.203.12@tcp:101:cat.0 Request processed in 204us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619955.761383:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788619955.768502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619955.768642:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056000 00000100:00100000:3.0:1788619955.768654:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056000 00002000:00100000:3.0:1788619955.768715:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff933285bfad80 x1875503657056000/t0(0) o3->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:51/0 lens 488/0 e 0 to 0 dl 1788619966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619955.768742:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933285bfad80 with x1875503657056000 ext(0->4095) 00002000:00010000:3.0:1788619955.768749:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff933285bfad80 00000100:00100000:3.0:1788619955.768824:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788619955.768834:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657056000:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:3.0:1788619955.769071:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657056000:12345-192.168.203.12@tcp:3:cat.0 Request processed in 237us (579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788619955.769079:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:3.0:1788619955.769087:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff933285bfad80 x1875503657056000/t0(0) o3->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:51/0 lens 488/4536 e 0 to 0 dl 1788619966 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619955.769096:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933285bfad80 with x1875503657056000 ext(0->4095) 00002000:00010000:3.0:1788619955.769099:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff933285bfad80 00000100:00100000:1.0:1788619955.911108:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788619955.911130:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676988672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619955.911201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619955.911370:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988672 00000100:00100000:0.0:1788619955.911379:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988672 00000100:00100000:0.0:1788619955.911432:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788619955.911442:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676988672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619955.911476:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619955.911529:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676988672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619955.911536:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788619955.911647:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676988672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619956.422938:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619956.422970:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676988800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619956.423065:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619956.423169:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988800 00000100:00100000:0.0:1788619956.423180:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988800 00000100:00100000:0.0:1788619956.423254:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788619956.423265:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676988800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619956.423314:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619956.423381:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676988800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619956.423389:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788619956.423482:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676988800:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788619956.510563:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788619956.510592:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:1.0:1788619956.679926:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619957.703502:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788619958.042561:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788619958.042582:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788619958.054887:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1788619958.054917:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333bc58d840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788619958.054923:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bb8dff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333bc58df00 00000020:00080000:1.0:1788619958.054926:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bb8df300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9333bd242800 00000020:00080000:1.0:1788619958.054959:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788619958.054971:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788619958.055252:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788619958.055538:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788619958.729003:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619959.759207:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619959.927628:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619959.927941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056128 00000100:00100000:0.0:1788619959.927953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056128 00000100:00100000:0.0:1788619959.928030:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1788619959.928042:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+13:10257:x1875503657056128:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788619959.928157:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+13:10257:x1875503657056128:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 117us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619959.928164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00080000:1.0:1788619959.928300:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619959.937655:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619959.937940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056384 00000100:00100000:3.0:1788619959.937956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056384 00000100:00100000:3.0:1788619959.938046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788619959.938058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:10257:x1875503657056384:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788619959.939025:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+14:10257:x1875503657056384:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 963us (1381us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788619959.939036:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788619960.222958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619960.223018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619960.223060:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619960.223103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619960.223181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056512 00000100:00100000:2.0:1788619960.223205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056512 00000100:00100000:1.0:1788619960.223254:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056640 00000100:00100000:1.0:1788619960.223264:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056640 00000100:00100000:2.0:1788619960.223307:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:1.0:1788619960.223334:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056768 00000100:00100000:2.0:1788619960.223335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657056512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619960.223342:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056768 00000100:00100000:1.0:1788619960.223376:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788619960.223389:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657056640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619960.223438:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657056512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619960.223448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:1.0:1788619960.223463:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+5:2354:x1875503657056640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619960.223472:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788619960.223500:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788619960.223511:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657056768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619960.223542:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657056768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619960.223547:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00080000:1.0:1788619960.223585:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619960.223597:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619960.223683:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657056896 00000100:00100000:0.0:1788619960.223688:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657056896 00000100:00100000:0.0:1788619960.223744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:0.0:1788619960.223751:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657056896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619960.223819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657056896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619960.223825:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00080000:1.0:1788619960.223897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619960.289003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619960.289180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057024 00000100:00100000:0.0:1788619960.289202:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057024 00000100:00100000:0.0:1788619960.289285:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788619960.289298:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:11064:x1875503657057024:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:0.0:1788619960.289324:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619960.289352:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaa5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289440:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289474:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619960.289521:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788619960.289526:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619960.289579:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289609:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbe9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289630:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619960.289641:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:0.0:1788619960.289644:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619960.289668:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2000, rc 0) 00000100:00100000:0.0:1788619960.289745:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+6:11064:x1875503657057024:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 450us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619960.289753:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:1.0:1788619960.519266:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676989312:0@lo:400:kworker.0 00000100:00100000:0.0:1788619960.519267:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676989056:0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.519425:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676988928:0@lo:400:kworker.0 00000100:00100000:1.0:1788619960.519515:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619960.519584:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676989184:0@lo:400:kworker.0 00000100:00100000:1.0:1788619960.519651:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989312 00000100:00100000:2.0:1788619960.519661:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619960.519664:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989312 00000100:00100000:1.0:1788619960.519739:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788619960.519752:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676989312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788619960.519813:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619960.519860:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989184 00000100:00100000:2.0:1788619960.519870:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989184 00000100:00100000:1.0:1788619960.519878:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676989312:12345-0@lo:400:kworker.0 Request processed in 127us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619960.519890:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788619960.519943:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788619960.519948:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000100:00100000:2.0:1788619960.519962:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000004:00080000:1.0:1788619960.519970:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bc6df100, transno 4294967304 00000100:00100000:2.0:1788619960.519979:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676989184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619960.520068:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676989184:12345-0@lo:400:kworker.0 Request processed in 95us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619960.520075:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788619960.520130:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676989184:0@lo:400:kworker.0 00000100:00080000:2.0:1788619960.520160:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619960.521208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676989312:0@lo:400:kworker.0 00000100:00100000:0.0:1788619960.521820:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619960.521903:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676989568:0@lo:400:kworker.0 00000100:00100000:1.0:1788619960.521954:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989056 00000100:00100000:1.0:1788619960.521965:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989056 00000100:00100000:1.0:1788619960.522048:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788619960.522058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676989056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619960.522166:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619960.522241:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989568 00000100:00100000:0.0:1788619960.522248:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989568 00000100:00100000:0.0:1788619960.522308:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788619960.522317:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676989568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619960.522367:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676989568:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619960.522374:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788619960.522908:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788619960.524915:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619960.525696:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676989440:0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.525811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619960.525880:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676988928 00000100:00100000:3.0:1788619960.525889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676988928 00000100:00100000:0.0:1788619960.526143:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788619960.526151:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333909dbb80, transno 4294967310 00000004:00080000:0.0:1788619960.526167:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788619960.526214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676989568:0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.527147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788619960.527165:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.527283:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676988928:12345-0@lo:400:kworker.0 Request processed in 124us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619960.527291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788619960.527344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989440 00000100:00100000:3.0:1788619960.527351:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989440 00000100:00100000:3.0:1788619960.527403:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788619960.527410:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676989440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.527447:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676989440:12345-0@lo:400:kworker.0 Request processed in 38us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619960.527454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788619960.527501:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676988928:0@lo:400:kworker.0 00000100:00100000:3.0:1788619960.527521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676989440:0@lo:400:kworker.0 00000100:00080000:3.0:1788619960.527585:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619960.531932:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676989056:12345-0@lo:400:kworker.0 Request processed in 9865us (10108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619960.531947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788619960.532077:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676989056:0@lo:400:kworker.0 00010000:00010000:1.0:1788619960.779559:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619961.034260:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676989696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619961.034361:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619961.034494:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989696 00000100:00100000:0.0:1788619961.034502:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989696 00000100:00100000:0.0:1788619961.034550:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788619961.034560:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676989696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619961.034594:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619961.034662:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676989696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619961.034669:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788619961.034836:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676989696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619961.545080:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788619961.545103:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676989824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788619961.545172:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619961.546256:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989824 00000100:00100000:0.0:1788619961.546266:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989824 00000100:00100000:0.0:1788619961.546320:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788619961.546329:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676989824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619961.546363:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619961.546427:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503676989824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619961.546434:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788619961.547154:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676989824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788619961.799726:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788619961.927031:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788619961.927041:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788619961.927332:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788619961.927339:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788619962.823379:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788619963.114008:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1788619963.114052:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788619963.114161:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788619963.114183:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1788619963.641120:0:12373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:52:43 (1788619963) 00010000:00010000:0.0:1788619963.850180:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619964.872470:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619964.988918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619964.989599:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057280 00000100:00100000:3.0:1788619964.989634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057280 00000100:00100000:3.0:1788619964.989752:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:3.0:1788619964.989768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+13:11330:x1875503657057280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619964.989836:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619964.989865:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe9f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.989965:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.989983:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.989997:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990013:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990020:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990026:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990365:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbea0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbea0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990383:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbea0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619964.990403:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788619964.990597:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990606:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990613:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990620:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619964.990624:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990633:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990647:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933388291c00) 00010000:00010000:3.0:1788619964.990650:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619964.990656:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990663:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbe9ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990677:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990682:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990698:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990703:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619964.990706:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990711:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990718:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff933388291100) 00010000:00010000:3.0:1788619964.990720:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619964.990723:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.990728:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.991333:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbe9f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaac expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.991353:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbea0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaac expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619964.991361:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:3.0:1788619964.991364:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619964.991366:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:3.0:1788619964.991456:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:11330:x1875503657057280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1693us (2555us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788619964.991476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00080000:0.0:1788619964.994168:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619964.995851:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619964.998121:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057408 00000100:00100000:2.0:1788619964.998142:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057408 00000100:00100000:2.0:1788619964.998325:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:2.0:1788619964.998355:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:11330:x1875503657057408:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788619964.998527:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:11330:x1875503657057408:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 190us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619964.998535:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000040:00080000:0.0:1788619964.999036:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788619964.999043:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788619964.999089:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788619964.999098:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619965.002224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619965.004432:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057536 00000100:00100000:1.0:1788619965.004446:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057536 00000100:00100000:1.0:1788619965.005470:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788619965.005489:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:2357:x1875503657057536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619965.005531:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619965.005559:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbea0d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaac expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619965.005581:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:1.0:1788619965.005587:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619965.005672:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+14:2357:x1875503657057536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 182us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.005679:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788619965.339461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619965.339513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619965.339554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619965.339583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619965.339619:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057920 00000100:00100000:1.0:1788619965.339632:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057920 00000100:00100000:1.0:1788619965.339706:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057792 00000100:00100000:1.0:1788619965.339709:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057792 00000100:00100000:1.0:1788619965.339736:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788619965.339748:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657057920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619965.339878:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657057920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.339896:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788619965.339915:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788619965.339922:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657057792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619965.339954:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657057792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.339960:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788619965.339980:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058048 00000100:00100000:1.0:1788619965.339985:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058048 00000100:00100000:1.0:1788619965.340020:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:1.0:1788619965.340027:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:2355:x1875503657058048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619965.340056:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:2355:x1875503657058048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.340063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00080000:1.0:1788619965.340080:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788619965.340086:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619965.340088:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788619965.340321:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657057664 00000100:00100000:3.0:1788619965.340327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657057664 00000100:00100000:3.0:1788619965.340369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:3.0:1788619965.340378:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657057664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619965.340469:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657057664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 92us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619965.340477:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:0.0:1788619965.639129:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676990208:0@lo:400:kworker.0 00000100:00100000:0.0:1788619965.639240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619965.640045:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676990080:0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.640102:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619965.640150:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676990592:0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.640191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619965.640249:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990208 00000100:00100000:3.0:1788619965.640259:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990208 00000100:00100000:3.0:1788619965.640325:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990080 00000100:00100000:3.0:1788619965.640328:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990080 00000100:00100000:3.0:1788619965.640351:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788619965.640361:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676990208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.640420:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676990208:12345-0@lo:400:kworker.0 Request processed in 60us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619965.640428:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788619965.640448:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788619965.640455:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676990080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.640514:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503676990080:12345-0@lo:400:kworker.0 Request processed in 59us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619965.640520:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788619965.640564:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503676990080:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.640667:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676990336:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.640730:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619965.640764:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619965.640801:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676989952:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.640832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619965.640856:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676990464:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.640879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619965.641093:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676990208:0@lo:400:kworker.0 00000100:00100000:0.0:1788619965.641120:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990464 00000100:00100000:0.0:1788619965.641125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990464 00000100:00100000:0.0:1788619965.641167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788619965.641184:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676990464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619965.641223:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676990464:12345-0@lo:400:kworker.0 Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619965.641230:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788619965.641329:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990592 00000100:00100000:1.0:1788619965.641334:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990592 00000100:00100000:1.0:1788619965.641374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990336 00000100:00100000:1.0:1788619965.641377:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990336 00000100:00100000:1.0:1788619965.641400:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788619965.641407:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676990592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619965.641454:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503676990592:12345-0@lo:400:kworker.0 Request processed in 47us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.641460:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788619965.641473:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788619965.641486:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676990336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619965.641515:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676990336:12345-0@lo:400:kworker.0 Request processed in 30us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619965.641522:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788619965.641541:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619965.641545:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619965.641549:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619965.641578:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676990592:0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.641840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676989952 00000100:00100000:3.0:1788619965.641844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676989952 00000100:00100000:3.0:1788619965.641886:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788619965.641893:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676989952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619965.641928:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676989952:12345-0@lo:400:kworker.0 Request processed in 36us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619965.641935:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788619965.642073:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676989952:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.642087:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676990464:0@lo:400:kworker.0 00000100:00100000:2.0:1788619965.642095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676990336:0@lo:400:kworker.0 00010000:00010000:0.0:1788619965.896013:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619966.152043:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676990720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619966.152137:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619966.153233:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990720 00000100:00100000:0.0:1788619966.153247:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990720 00000100:00100000:0.0:1788619966.153306:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788619966.153317:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676990720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619966.153368:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619966.153456:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676990720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619966.153464:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788619966.154351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676990720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619966.667278:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676990848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619966.667352:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619966.667463:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676990848 00000100:00100000:2.0:1788619966.667471:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676990848 00000100:00100000:2.0:1788619966.667529:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788619966.667541:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676990848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788619966.667576:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788619966.667629:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676990848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619966.667637:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788619966.667698:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676990848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619966.918968:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619967.046542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.046733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058176 00000100:00100000:0.0:1788619967.046744:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058176 00000100:00100000:0.0:1788619967.046983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1788619967.046996:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:11372:x1875503657058176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619967.047016:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.047036:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbea1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aab3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047101:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047116:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047129:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047164:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047172:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047178:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047624:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047634:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047640:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047647:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.047652:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047660:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047672:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:0.0:1788619967.047675:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.047680:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047686:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047703:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047710:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047717:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047722:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.047725:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047732:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047740:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93338385ae00) 00010000:00010000:0.0:1788619967.047742:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.047746:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047752:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047935:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbea1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aab3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047948:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:0.0:1788619967.047950:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.047960:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbea1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aab3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.047970:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3a00, rc 0) 00000100:00100000:0.0:1788619967.048037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:11372:x1875503657058176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1043us (1504us total) trans 0 rc 301/301 00000100:00100000:0.0:1788619967.048044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00080000:1.0:1788619967.048129:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788619967.057507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.058403:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058432 00000100:00100000:1.0:1788619967.058414:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058432 00000100:00100000:1.0:1788619967.058470:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:1.0:1788619967.058479:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+14:11372:x1875503657058432:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1788619967.058530:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619967.058555:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fc00/0xbb0e330328bbe399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8ec expref: 14 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.058570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:1.0:1788619967.058575:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619967.058788:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.058803:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.058812:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.058853:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.058867:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 5 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619967.058880:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676990976:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619967.058963:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc58df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619967.063154:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.063206:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676990976:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619967.063232:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.063330:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058560 00000100:00100000:0.0:1788619967.063337:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058560 00010000:00010000:0.0:1788619967.063387:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 6 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.063417:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788619967.063426:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b894fa53-facf-4302-9d74-955690a8c92e+6:2354:x1875503657058560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619967.063438:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1788619967.063443:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788619967.063445:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 6 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063457:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 6 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063478:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbe9f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaa5 expref: 6 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063492:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:0.0:1788619967.063497:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063516:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063523:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.063542:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619967.063596:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657058560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 170us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619967.063603:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00010000:00010000:3.0:1788619967.063752:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.063759:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.063887:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.063904:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.068372:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619967.071932:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788619967.071954:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.071965:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.071972:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.071978:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.071983:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.071991:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.072008:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117900) 00010000:00010000:3.0:1788619967.072011:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.072016:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.072023:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbea30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619967.072054:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007482034f reply state 000000004cbe3f18 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.072063:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619967.072228:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+15:11372:x1875503657058432:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 13744us (14726us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788619967.072238:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00010000:00010000:3.0:1788619967.084379:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084396:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084404:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084410:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.084414:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084423:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084439:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff933388291400) 00010000:00010000:3.0:1788619967.084443:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.084447:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.084455:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619967.172087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.172205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058688 00000100:00100000:0.0:1788619967.172215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058688 00000100:00100000:0.0:1788619967.172312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1788619967.172323:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+14:11380:x1875503657058688:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788619967.172345:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.172372:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbea3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaba expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172436:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172461:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172476:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619967.172545:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788619967.172550:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619967.172588:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172619:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbea3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaba expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172646:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaba expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.172656:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619967.172658:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619967.172662:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788619967.172723:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+15:11380:x1875503657058688:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 402us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619967.172730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:1.0:1788619967.264528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.264626:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657058816 00000100:00100000:3.0:1788619967.264636:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657058816 00000100:00100000:3.0:1788619967.264699:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:3.0:1788619967.264710:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+15:11386:x1875503657058816:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788619967.264731:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619967.264752:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aac1 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264852:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264865:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264877:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264892:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264899:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264905:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.264998:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265007:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265027:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619967.265057:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788619967.265060:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619967.265078:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265091:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265098:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265105:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265112:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.265116:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265124:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265135:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788619967.265138:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.265156:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265164:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbea53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265189:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265196:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265202:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265207:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.265210:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265216:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265223:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff933388291400) 00010000:00010000:3.0:1788619967.265225:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.265228:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265233:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbea5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265266:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac1 expref: 17 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265279:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac1 expref: 16 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.265295:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619967.265298:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788619967.265301:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:3.0:1788619967.265356:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+16:11386:x1875503657058816:12345-192.168.203.12@tcp:101:bash.0 Request processed in 647us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.265363:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788619967.273808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.274261:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059072 00000100:00100000:0.0:1788619967.274271:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059072 00000100:00100000:0.0:1788619967.274340:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:0.0:1788619967.274350:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+16:11386:x1875503657059072:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619967.274377:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.274401:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aac8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.274532:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.274547:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.275696:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.275759:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.275784:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.275792:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619967.277533:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788619967.277992:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278008:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278019:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278053:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278059:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278065:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278071:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.278084:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278093:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278107:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619967.278111:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.278116:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278122:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbea6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619967.278214:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a3e20dc reply state 00000000007678da transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.278221:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788619967.278259:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbea68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278273:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.278280:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788619967.278282:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619967.278284:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2c00, rc 0) 00000100:00100000:0.0:1788619967.278485:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:11386:x1875503657059072:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4134us (4720us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788619967.278494:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00010000:00010000:1.0:1788619967.283818:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283837:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283844:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283851:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619967.283856:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283863:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283898:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385a800) 00010000:00010000:1.0:1788619967.283901:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619967.283906:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.283913:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbea76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.286650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.287244:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059200 00000100:00100000:1.0:1788619967.287254:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059200 00000100:00100000:1.0:1788619967.287330:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788619967.287340:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657059200:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788619967.287357:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619967.287376:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aacf expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788619967.287400:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788619967.287417:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1788619967.287421:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619967.287430:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.287451:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.287465:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143a00, rc 0) 00000100:00100000:1.0:1788619967.287524:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2356:x1875503657059200:12345-192.168.203.12@tcp:101:bash.0 Request processed in 186us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619967.287543:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00080000:2.0:1788619967.287766:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788619967.302966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.303248:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059328 00000100:00100000:0.0:1788619967.303259:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059328 00000100:00100000:0.0:1788619967.303444:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788619967.303457:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+6:11386:x1875503657059328:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619967.303474:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.303492:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aad6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.303521:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.303530:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619967.303534:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619967.303540:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.303943:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.303958:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.303972:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676991104:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619967.304065:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788619967.307570:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1875503676991104:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619967.307889:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.307911:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:1.0:1788619967.307966:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:11386:x1875503657059328:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4513us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619967.307975:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788619967.308037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.308175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059456 00000100:00100000:3.0:1788619967.308182:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059456 00010000:00010000:3.0:1788619967.308213:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.308243:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788619967.308250:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657059456:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619967.308262:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619967.308281:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.308302:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.308325:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbea8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aacf expref: 7 pid: 6692 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.308338:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619967.308352:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619967.308360:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.308370:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.308400:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.308413:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875503676991232:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788619967.308468:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788619967.313582:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875503676991232:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788619967.313616:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619967.313685:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657059456:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5427us (5641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.313697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788619967.315358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.315512:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059712 00000100:00100000:3.0:1788619967.315521:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059712 00000100:00100000:3.0:1788619967.315586:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788619967.315605:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:11386:x1875503657059712:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788619967.316282:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:11386:x1875503657059712:12345-192.168.203.12@tcp:35:bash.0 Request processed in 684us (928us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788619967.316292:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788619967.466228:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.466322:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657059968 00000100:00100000:3.0:1788619967.466332:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657059968 00000100:00100000:3.0:1788619967.466458:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:3.0:1788619967.466468:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:11397:x1875503657059968:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619967.466493:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619967.466512:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aadd expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619967.466591:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788619967.466703:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aadd expref: 21 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.466717:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788619967.466721:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619967.466725:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbea99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aadd expref: 21 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.466740:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1c00, rc 0) 00000100:00100000:3.0:1788619967.466840:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+20:11397:x1875503657059968:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 374us (623us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788619967.466847:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1788619967.480061:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.480201:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657060224 00000100:00100000:0.0:1788619967.480211:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657060224 00000100:00100000:0.0:1788619967.480275:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788619967.480284:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+20:11397:x1875503657060224:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619967.480507:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:11397:x1875503657060224:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 222us (462us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788619967.480514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788619967.587374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.587599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657060352 00000100:00100000:1.0:1788619967.587609:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657060352 00000100:00100000:1.0:1788619967.588129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:1.0:1788619967.588152:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:11403:x1875503657060352:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619967.588178:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619967.588210:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbeaa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aae4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.588281:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.588295:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.588308:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619967.588363:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788619967.588367:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619967.588386:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.589350:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbeaa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aae4 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.589379:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aae4 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.589388:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619967.589391:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788619967.589395:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142e00, rc 0) 00000100:00100000:1.0:1788619967.589480:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+22:11403:x1875503657060352:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1340us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619967.589488:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1788619967.597890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.597953:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657060608 00000100:00100000:1.0:1788619967.597969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657060608 00000100:00100000:1.0:1788619967.598223:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:1.0:1788619967.598247:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:11403:x1875503657060608:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619967.598272:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619967.598295:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbeab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaeb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.598396:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbeabc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.598437:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbeabc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.598449:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbeabc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619967.598462:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788619967.598615:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbeab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaeb expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.598635:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbeabc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaeb expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.598644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:1.0:1788619967.598647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619967.598651:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142800, rc 0) 00000100:00100000:1.0:1788619967.598738:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:11403:x1875503657060608:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 505us (864us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788619967.598745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:2.0:1788619967.603110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.604379:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657060864 00000100:00100000:1.0:1788619967.604392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657060864 00000100:00100000:1.0:1788619967.604451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:1.0:1788619967.604462:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:11403:x1875503657060864:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619967.604492:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619967.604517:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbeaca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.604656:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.604672:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.604684:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619967.604696:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788619967.605071:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbeaca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf2 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.605091:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf2 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.605101:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:1.0:1788619967.605104:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788619967.605107:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142600, rc 0) 00000100:00100000:1.0:1788619967.613014:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:11403:x1875503657060864:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 8540us (9901us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788619967.613032:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1788619967.613410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.614331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657060992 00000100:00100000:3.0:1788619967.614348:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657060992 00000100:00100000:3.0:1788619967.614454:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788619967.614466:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:2354:x1875503657060992:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619967.614486:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619967.614521:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbeabc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaeb expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.614569:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:3.0:1788619967.614576:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619967.614651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+25:2354:x1875503657060992:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 186us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.614659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788619967.624569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619967.624647:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061120 00000100:00100000:2.0:1788619967.624658:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061120 00000100:00100000:2.0:1788619967.624751:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788619967.624814:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657061120:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:2.0:1788619967.624864:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.624907:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.624916:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619967.624922:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619967.624927:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.624970:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.624991:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 6 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619967.625010:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875503676991360:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619967.625150:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788619967.628028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.628201:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061248 00000100:00100000:3.0:1788619967.628211:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061248 00000100:00100000:1.0:1788619967.628222:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875503676991360:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619967.628259:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788619967.628628:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93338715e680 x1875503657061248/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:63/0 lens 504/0 e 0 to 0 dl 1788619978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619967.628640:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93338715e680 with x1875503657061248 ext(0->12) 00010000:00010000:3.0:1788619967.628650:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 7 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.628668:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 7 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619967.628678:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93338715e680 00000100:00100000:3.0:1788619967.628728:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788619967.628742:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657061248:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788619967.629625:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657061248:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 879us (1613us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788619967.629636:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:3.0:1788619967.629647:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93338715e680 x1875503657061248/t4294967305(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:63/0 lens 504/448 e 0 to 0 dl 1788619978 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619967.629671:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93338715e680 with x1875503657061248 ext(0->12) 00010000:00010000:3.0:1788619967.629681:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.629697:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619967.629704:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93338715e680 00000100:00100000:2.0:1788619967.635978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.636072:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061376 00000100:00100000:1.0:1788619967.636103:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061376 00010000:00010000:1.0:1788619967.636163:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619967.636217:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788619967.636228:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657061376:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619967.636245:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788619967.636270:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788619967.636274:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788619968 00002000:00010000:1.0:1788619967.636280:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788619968 00002000:00010000:1.0:1788619967.636283:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788619968 00010000:00010000:1.0:1788619967.636296:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.636312:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.636339:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbea92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aad6 expref: 9 pid: 6689 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.636357:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788619967.636362:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788619967.636369:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.636381:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619967.636441:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619967.636515:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657061376:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 288us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619967.636523:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00010000:00010000:2.0:1788619967.636652:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636662:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636696:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636712:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636721:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636729:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619967.636734:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636745:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636759:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619967.636766:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acbc4707/0xbb0e330328bbeadf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619967.637159:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657061120:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 12396us (12611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619967.637169:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788619967.642919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.643236:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061632 00000100:00100000:0.0:1788619967.643251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061632 00000100:00100000:0.0:1788619967.643326:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788619967.643338:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+25:11403:x1875503657061632:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1788619967.643431:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf2 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619967.644306:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788619967.644370:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788619967.645513:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788619967.645605:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.645630:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.645642:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.648002:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.648064:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 29 pid: 5840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.648085:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676991488:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619967.648284:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619967.654647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619967.654848:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875503676991488:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619967.654909:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.655188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061760 00000100:00100000:3.0:1788619967.655198:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061760 00010000:00010000:3.0:1788619967.655251:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 30 pid: 5840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.655301:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788619967.655313:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387305450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+30:2355:x1875503657061760:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619967.655333:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619967.655342:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 30 pid: 5840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655356:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 30 pid: 5840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655382:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbea7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac8 expref: 30 pid: 5840 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655403:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:3.0:1788619967.655415:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655427:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655436:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.655474:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619967.655554:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387305450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:2355:x1875503657061760:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 242us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.655563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:0.0:1788619967.655675:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.655684:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619967.655891:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788619967.656148:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788619967.656285:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676991616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788619967.656351:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619967.656398:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338f96f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788619967.656763:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676991616 00000100:00100000:3.0:1788619967.656790:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676991616 00000100:00100000:3.0:1788619967.656863:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788619967.656873:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676991616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788619967.656976:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676991616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.656984:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788619967.657269:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619967.657596:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676991616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619967.658264:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788619967.658369:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676991744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788619967.658438:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619967.658473:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619967.658933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676991744 00000100:00100000:3.0:1788619967.658944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676991744 00000100:00100000:3.0:1788619967.659009:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788619967.659019:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875503676991744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788619967.659257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875503676991744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 239us (817us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788619967.659265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788619967.660023:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875503676991744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788619967.660123:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788619967.660199:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.660231:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.660239:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.660246:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.660253:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.660263:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.660286:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788619967.660290:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788619967.661412:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.661435:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeae6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619967.666286:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788619967.666515:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788619967.666534:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370634762006ns, next at 371634756923ns, rc = 0 00000001:00080000:0.0:1788619967.666550:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788619967.666633:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788619967.666639:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788619967.666654:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbead1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf2 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.666877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11403:x1875503657061632:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 23539us (23974us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788619967.666889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000020:00080000:0.0:1788619967.666897:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788619967.670093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.670186:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657061888 00000100:00100000:3.0:1788619967.670199:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657061888 00000100:00100000:3.0:1788619967.670313:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1788619967.670326:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+32:11403:x1875503657061888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619967.670357:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619967.670389:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbeaed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aaf9 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.670487:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbeaed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf9 expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.670505:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbeaed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf9 expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.670528:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619967.670532:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619967.670537:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1c00, rc 0) 00000100:00100000:3.0:1788619967.670619:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+33:11403:x1875503657061888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 297us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.670626:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:2.0:1788619967.679251:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.679608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657062144 00000100:00100000:1.0:1788619967.679623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657062144 00000100:00100000:1.0:1788619967.679700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788619967.680407:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:11403:x1875503657062144:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788619967.680768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+34:11403:x1875503657062144:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 1053us (1530us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788619967.680798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788619967.765025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.765154:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657062400 00000100:00100000:0.0:1788619967.765167:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657062400 00000100:00100000:0.0:1788619967.765248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1788619967.765260:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+34:11413:x1875503657062400:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619967.765291:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.765318:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeaf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab00 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619967.765445:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788619967.765723:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeaf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab00 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.765741:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619967.765744:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619967.765751:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeaf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab00 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.765767:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788619967.766449:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:11413:x1875503657062400:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1188us (1437us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788619967.766460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1788619967.770532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619967.770626:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657062528 00000100:00100000:3.0:1788619967.770639:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657062528 00000100:00100000:3.0:1788619967.770724:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:3.0:1788619967.770736:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+35:11413:x1875503657062528:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788619967.770894:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.770915:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.770951:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.770969:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771277:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771286:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771418:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771427:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771434:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619967.771491:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771506:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771513:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771520:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771538:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.771543:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771552:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771567:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619967.771571:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.771576:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771584:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbeb02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771601:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771608:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771614:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771620:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.771623:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771630:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771650:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933388291e00) 00010000:00010000:3.0:1788619967.771652:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.771656:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771661:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771694:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771700:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771707:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771712:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619967.771715:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771722:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771729:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619967.771732:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619967.771735:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619967.771741:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619967.772160:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+35:11413:x1875503657062528:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1419us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619967.772172:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:3.0:1788619967.774548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.774690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657062784 00000100:00100000:0.0:1788619967.774705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657062784 00000100:00100000:0.0:1788619967.774888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788619967.774901:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:11413:x1875503657062784:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619967.775351:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+36:11413:x1875503657062784:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 451us (816us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788619967.775360:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788619967.811200:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.811341:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657063040 00000100:00100000:0.0:1788619967.811355:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657063040 00000100:00100000:0.0:1788619967.811486:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:0.0:1788619967.811503:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+36:11416:x1875503657063040:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619967.811534:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619967.811566:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeb17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab07 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811668:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811687:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811703:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811720:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811728:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.811755:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814263:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814403:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814422:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619967.814439:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788619967.814579:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814587:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814595:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814601:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.814607:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814617:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814634:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619967.814638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.814663:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814670:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814688:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814695:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814700:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814706:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.814709:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814716:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814725:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385a100) 00010000:00010000:0.0:1788619967.814728:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619967.814731:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814737:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.814943:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeb17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.815045:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.815054:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:0.0:1788619967.815057:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619967.815060:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3c00, rc 0) 00000100:00100000:0.0:1788619967.815246:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+38:11416:x1875503657063040:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 3747us (4058us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788619967.815256:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:2.0:1788619967.819651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619967.819916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657063168 00000100:00100000:0.0:1788619967.819931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657063168 00000100:00100000:0.0:1788619967.820009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788619967.820022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+38:11416:x1875503657063168:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788619967.820119:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820152:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820167:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820201:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820210:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820239:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820246:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619967.820251:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820261:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820276:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:0.0:1788619967.820280:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619967.820286:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619967.820293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbeb3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619967.820491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+38:11416:x1875503657063168:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 471us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619967.820500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:3.0:1788619967.825517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619967.825621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657063424 00000100:00100000:1.0:1788619967.825636:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657063424 00000100:00100000:1.0:1788619967.825718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788619967.825730:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+38:11416:x1875503657063424:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788619967.826086:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+39:11416:x1875503657063424:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 356us (583us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788619967.826095:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:0.0:1788619967.943126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619968.045077:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.045239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657063680 00000100:00100000:1.0:1788619968.045252:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657063680 00000100:00100000:1.0:1788619968.045330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:1.0:1788619968.045342:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+39:11447:x1875503657063680:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788619968.045372:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619968.045397:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbeb41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab0e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.045536:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbeb48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.045555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbeb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.045571:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbeb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619968.045584:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788619968.045761:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbeb41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab0e expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.045843:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbeb48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab0e expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.045853:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.045856:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619968.045861:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143200, rc 0) 00000100:00100000:1.0:1788619968.045944:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+41:11447:x1875503657063680:12345-192.168.203.12@tcp:101:cat.0 Request processed in 604us (881us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788619968.045953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:2.0:1788619968.050174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.050265:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657063808 00000100:00100000:1.0:1788619968.050279:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657063808 00000100:00100000:1.0:1788619968.050374:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788619968.050387:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+41:2354:x1875503657063808:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619968.050409:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.050461:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbeb48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab0e expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.050485:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.050492:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619968.050569:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+40:2354:x1875503657063808:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 184us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.050576:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788619968.053128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.053227:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657064064 00000100:00100000:1.0:1788619968.053240:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657064064 00000100:00100000:1.0:1788619968.053321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788619968.053333:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+40:11447:x1875503657064064:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788619968.053958:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+41:11447:x1875503657064064:12345-192.168.203.12@tcp:35:cat.0 Request processed in 622us (839us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788619968.053967:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788619968.109975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619968.110455:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657064320 00000100:00100000:3.0:1788619968.110470:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657064320 00000100:00100000:3.0:1788619968.110600:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1788619968.110611:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+41:11453:x1875503657064320:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788619968.110641:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619968.110644:0:8707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788619968.110686:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeaae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aae4 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.110710:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619968.110725:0:8707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619968.110742:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab15 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.110921:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.110935:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.110945:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.111006:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.111023:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 41 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.111038:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb94700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676991872:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619968.111174:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619968.113946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.114050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657064448 00000100:00100000:1.0:1788619968.114064:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657064448 00010000:00010000:1.0:1788619968.114115:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.114176:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1788619968.114188:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+42:2354:x1875503657064448:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619968.114207:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.114215:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.114232:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.114281:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.114298:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.114311:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.114321:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.114346:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619968.114408:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+42:2354:x1875503657064448:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 222us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.114416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:3.0:1788619968.115363:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeb2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab07 expref: 41 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.115390:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb94700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676991872:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619968.115420:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.115431:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.115437:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619968.115464:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788619968.115664:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbeb56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 42 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.115683:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 41 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.115730:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.115735:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788619968.115738:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0e00, rc 0) 00000100:00100000:3.0:1788619968.115835:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+41:11453:x1875503657064320:12345-192.168.203.12@tcp:101:dd.0 Request processed in 5225us (5873us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788619968.115844:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:2.0:1788619968.119077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.119195:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657064704 00000100:00100000:1.0:1788619968.119209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657064704 00000100:00100000:1.0:1788619968.119386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:1.0:1788619968.119400:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+41:11453:x1875503657064704:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1788619968.119846:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.119866:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.119879:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619968.119943:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788619968.119970:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7ac7cfd reply state 000000000a016e50 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.119988:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788619968.120108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+44:11453:x1875503657064704:12345-192.168.203.12@tcp:36:dd.0 Request processed in 710us (1042us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788619968.120116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000020:00080000:1.0:1788619968.120122:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788619968.126436:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126459:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126468:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126476:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619968.126482:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126492:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126515:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.126518:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619968.126524:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.126530:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619968.260033:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000004:00080000:1.0:1788619968.260058:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788619968.260083:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93338f96fb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788619968.260089:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93339025f000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93338f96f180 00000020:00080000:1.0:1788619968.260092:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93339025f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9333bd0a4800 00000001:00080000:1.0:1788619968.260124:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:1.0:1788619968.260178:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788619968.260410:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788619968.260893:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676992000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788619968.260989:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619968.261384:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676992000 00000100:00100000:0.0:1788619968.261395:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676992000 00000100:00100000:0.0:1788619968.261464:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788619968.261475:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676992000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788619968.261627:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788619968.261738:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c2cc0, atime: 0x6a9c2cc0, ctime: 0x6a9c2cc0, blocks: 0x1 00010000:00010000:0.0:1788619968.261749:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.261827:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1788619968.261833:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619968.261842:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.261862:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.261873:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.261882:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.261898:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788619968.262395:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788619968.262406:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.262418:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788619968.262424:0:7635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.262435:0:7635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.262467:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.262475:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c72263f2/0xbb0e330328bbeb72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.262498:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619968.262574:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619968.262576:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619968.263410:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676992000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1929us (2413us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788619968.263424:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1788619968.263590:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff933285bfbb80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788619968.263600:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676992000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788619968.333913:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619968.334037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657064832 00000100:00100000:0.0:1788619968.334050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657064832 00000100:00100000:0.0:1788619968.334143:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1788619968.334155:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+16:11467:x1875503657064832:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788619968.334189:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619968.334217:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeb79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab1c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334458:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334502:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334520:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334527:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619968.334534:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.340256:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.340442:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 17 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.340455:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.340976:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 17 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.341000:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 17 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619968.341037:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676992128:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619968.341516:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619968.347849:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619968.347993:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676992128:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619968.348031:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.348399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657065088 00000100:00100000:3.0:1788619968.348408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657065088 00000100:00100000:3.0:1788619968.348489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788619968.348512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:5594:x1875503657065088:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788619968.349169:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:5594:x1875503657065088:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 667us (1331us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788619968.349178:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788619968.357809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.358002:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657065216 00000100:00100000:1.0:1788619968.358014:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657065216 00010000:00010000:1.0:1788619968.358075:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 19 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.358906:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788619968.358936:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:2354:x1875503657065216:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619968.358958:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.358970:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 19 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.358988:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 19 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.359036:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbeb5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab15 expref: 19 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.359056:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.359062:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.359176:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.359186:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.359369:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619968.359461:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:2354:x1875503657065216:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 541us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.359469:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00010000:00010000:2.0:1788619968.364235:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364252:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619968.364306:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788619968.364311:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619968.364352:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364368:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364380:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364386:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364394:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364407:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619968.364430:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364439:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364455:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619968.364458:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619968.364463:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbeb80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364489:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364525:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364533:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364538:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619968.364541:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364546:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364554:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385a500) 00010000:00010000:2.0:1788619968.364556:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619968.364565:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364570:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbeb87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364617:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeb79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab1c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364631:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab1c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.364639:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:2.0:1788619968.364641:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619968.364644:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619968.364725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+17:11467:x1875503657064832:12345-192.168.203.12@tcp:101:stat.0 Request processed in 30572us (30826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619968.364733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1788619968.437960:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.438021:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657065472 00000100:00100000:1.0:1788619968.438031:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657065472 00000100:00100000:1.0:1788619968.438263:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1788619968.438273:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+17:11473:x1875503657065472:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:1.0:1788619968.438444:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.438472:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbeb8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab1c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.438493:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.438499:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619968.438890:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.438906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.438916:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619968.438963:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788619968.438984:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ed59dd6 reply state 00000000ad1981cf transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.438993:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788619968.439304:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:11473:x1875503657065472:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 1029us (1351us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788619968.439323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000020:00080000:1.0:1788619968.439330:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788619968.443361:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443378:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443385:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443392:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619968.443396:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443404:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443441:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.443444:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619968.443449:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.443455:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619968.577524:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.578004:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657065600 00000100:00100000:1.0:1788619968.578019:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657065600 00000100:00100000:1.0:1788619968.578175:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:1.0:1788619968.578189:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:11487:x1875503657065600:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1788619968.578221:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619968.578264:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab23 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578369:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578387:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578402:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578421:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578428:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.578470:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579108:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579120:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579598:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619968.579658:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788619968.579673:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619968.579707:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579724:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579735:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579742:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579749:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579755:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619968.579760:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579970:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.579989:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619968.579992:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619968.579998:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580006:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbeba3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580022:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580028:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580035:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580040:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619968.580043:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580048:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580056:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933390117b00) 00010000:00010000:1.0:1788619968.580058:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619968.580061:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580078:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580126:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbeb9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580151:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 19 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.580159:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.580162:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619968.580165:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143200, rc 0) 00000100:00100000:1.0:1788619968.580516:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:11487:x1875503657065600:12345-192.168.203.12@tcp:101:stat.0 Request processed in 2329us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.580526:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:0.0:1788619968.668611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619968.668969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657065856 00000100:00100000:3.0:1788619968.668981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657065856 00000100:00100000:3.0:1788619968.669060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:3.0:1788619968.669075:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+19:11497:x1875503657065856:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619968.669103:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619968.669140:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab2a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619968.669291:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788619968.669473:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab2a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.669490:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788619968.669493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619968.670103:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab2a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.670125:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0a00, rc 0) 00000100:00100000:3.0:1788619968.670219:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+20:11497:x1875503657065856:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1149us (1624us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788619968.670245:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:3.0:1788619968.674459:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619968.674566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657066112 00000100:00100000:0.0:1788619968.674580:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657066112 00000100:00100000:0.0:1788619968.674652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788619968.674672:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+20:11497:x1875503657066112:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619968.675048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:11497:x1875503657066112:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 384us (603us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788619968.675079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788619968.737737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619968.737923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657066368 00000100:00100000:2.0:1788619968.737938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657066368 00000100:00100000:2.0:1788619968.738025:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788619968.738037:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:11503:x1875503657066368:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619968.738069:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619968.738296:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbebc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab31 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.738432:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.738471:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 22 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.738481:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.738521:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 22 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.738537:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 22 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619968.738554:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676992256:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619968.738901:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619968.744150:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676992256:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619968.744195:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619968.744362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.744461:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657066496 00000100:00100000:1.0:1788619968.744470:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657066496 00010000:00010000:1.0:1788619968.744517:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 23 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.744565:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788619968.744576:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:2355:x1875503657066496:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619968.744596:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.744604:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 23 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.744642:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 23 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.744671:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab23 expref: 23 pid: 8707 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.744691:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.744697:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.745852:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.745865:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.745909:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619968.746227:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.746237:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619968.746266:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788619968.746554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbebc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.746580:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.746590:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.746594:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788619968.746597:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:1.0:1788619968.746674:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:2355:x1875503657066496:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 2097us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.746687:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788619968.747716:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+22:11503:x1875503657066368:12345-192.168.203.12@tcp:101:bash.0 Request processed in 9662us (9976us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788619968.747729:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:0.0:1788619968.755145:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.755289:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657066752 00000100:00100000:1.0:1788619968.755301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657066752 00000100:00100000:1.0:1788619968.755375:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:1.0:1788619968.755387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+22:11503:x1875503657066752:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788619968.755755:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.755800:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.755836:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619968.755899:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788619968.755928:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000018497bb reply state 00000000d543a811 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.755939:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788619968.758751:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+25:11503:x1875503657066752:12345-192.168.203.12@tcp:36:bash.0 Request processed in 3346us (3613us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788619968.758766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000020:00080000:1.0:1788619968.758792:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788619968.770940:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.770987:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.770995:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.771002:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619968.771008:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.771017:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.771040:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.771043:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619968.771050:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.771056:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbebdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619968.772564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.779396:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657066880 00000100:00100000:1.0:1788619968.779420:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657066880 00000100:00100000:1.0:1788619968.779514:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1788619968.779528:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+24:11503:x1875503657066880:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788619968.779560:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619968.779589:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbebe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab38 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.779701:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.779719:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.779729:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.779820:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.779836:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 25 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619968.779853:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676992384:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619968.779976:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788619968.783159:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.783450:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676992384:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619968.783491:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.783656:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657067008 00000100:00100000:3.0:1788619968.783675:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657067008 00010000:00010000:3.0:1788619968.783725:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 26 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.783812:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788619968.783825:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+26:2354:x1875503657067008:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619968.783842:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619968.783867:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 26 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.783881:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 26 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.783910:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbebcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab31 expref: 26 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.783928:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.783934:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.783945:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.783954:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.784048:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619968.784119:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+25:2354:x1875503657067008:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 296us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619968.784127:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00010000:00010000:2.0:1788619968.785394:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.785413:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619968.785485:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788619968.785491:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619968.785519:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.785573:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbebe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab38 expref: 25 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.785616:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab38 expref: 24 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.785626:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:2.0:1788619968.785630:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619968.785634:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142a00, rc 0) 00000100:00100000:2.0:1788619968.785929:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+24:11503:x1875503657066880:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6402us (13375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619968.785940:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:2.0:1788619968.789162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619968.789274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657067264 00000100:00100000:0.0:1788619968.789356:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657067264 00000100:00100000:0.0:1788619968.789463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788619968.789475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:11503:x1875503657067264:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788619968.790043:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+25:11503:x1875503657067264:12345-192.168.203.12@tcp:35:bash.0 Request processed in 567us (892us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788619968.790053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788619968.888205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619968.892497:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657067520 00000100:00100000:2.0:1788619968.892527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657067520 00000100:00100000:2.0:1788619968.892639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1788619968.892653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+25:11513:x1875503657067520:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619968.892695:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619968.892725:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbebf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619968.892902:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788619968.893059:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbebf0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab3f expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.893101:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:2.0:1788619968.893104:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619968.893110:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbebf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab3f expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.893128:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb400, rc 0) 00000100:00100000:2.0:1788619968.893234:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:11513:x1875503657067520:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 584us (5042us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788619968.893243:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:0.0:1788619968.897979:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619968.898194:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657067648 00000100:00100000:3.0:1788619968.898208:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657067648 00000100:00100000:3.0:1788619968.898292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1788619968.898986:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+26:11513:x1875503657067648:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788619968.899420:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.899468:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.899485:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.899506:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.899513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.899519:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901451:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901492:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619968.901563:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901579:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901586:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901610:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901617:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619968.901622:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901632:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901648:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619968.901651:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619968.901658:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901665:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbebfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901680:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901686:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901691:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901697:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619968.901700:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901716:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901725:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933388291100) 00010000:00010000:3.0:1788619968.901727:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619968.901731:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.901737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902163:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902173:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902179:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902185:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619968.902188:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902272:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902285:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788619968.902289:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619968.902293:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619968.902316:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619968.902443:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+26:11513:x1875503657067648:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 4135us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619968.902455:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1788619968.913516:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619968.913650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657067904 00000100:00100000:3.0:1788619968.913664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657067904 00000100:00100000:3.0:1788619968.913744:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788619968.913758:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:11513:x1875503657067904:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788619968.914241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:11513:x1875503657067904:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 484us (737us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788619968.914251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788619968.959924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.960012:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657068160 00000100:00100000:1.0:1788619968.960029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657068160 00000100:00100000:1.0:1788619968.960122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788619968.960141:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+27:11516:x1875503657068160:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619968.960174:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619968.960202:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbec13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab46 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960296:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960313:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960328:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960362:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960370:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.960386:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961270:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961296:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961307:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788619968.961320:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788619968.961957:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961968:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961975:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.961982:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619968.961988:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962012:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962028:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619968.962032:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619968.962038:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962045:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbec1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962061:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962067:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962073:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962079:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619968.962081:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962087:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962095:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933390117b00) 00010000:00010000:1.0:1788619968.962097:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619968.962100:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962138:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbec21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962209:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbec13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab46 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962226:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab46 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.962235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.962238:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619968.962241:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142800, rc 0) 00000100:00100000:1.0:1788619968.962339:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+29:11516:x1875503657068160:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2206us (2424us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788619968.962350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00010000:00010000:0.0:1788619968.970223:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619968.970585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619968.970701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619968.971551:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657068416 00000100:00100000:1.0:1788619968.971564:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657068416 00000100:00100000:1.0:1788619968.971635:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788619968.971646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+29:2354:x1875503657068416:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619968.971662:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619968.971687:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab46 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619968.971720:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619968.971725:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619968.971801:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+28:2354:x1875503657068416:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 156us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619968.971824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788619968.975597:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657068288 00000100:00100000:2.0:1788619968.975612:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657068288 00000100:00100000:2.0:1788619968.975691:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1788619968.975702:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:11516:x1875503657068288:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788619968.975796:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.975826:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.975840:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976204:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976213:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976238:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976244:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619968.976249:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976257:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976270:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:2.0:1788619968.976273:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619968.976278:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619968.976284:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619968.981834:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:11516:x1875503657068288:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 6119us (11239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619968.981850:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1788619968.990848:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619968.991020:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657068672 00000100:00100000:3.0:1788619968.991033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657068672 00000100:00100000:3.0:1788619968.991101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788619968.991113:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+28:11516:x1875503657068672:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788619968.991449:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+29:11516:x1875503657068672:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 336us (615us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788619968.991458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788619969.157861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619969.157996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657068928 00000100:00100000:2.0:1788619969.158011:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657068928 00000100:00100000:2.0:1788619969.158116:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1788619969.158137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:11534:x1875503657068928:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788619969.158160:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619969.158183:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab4d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619969.158298:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbec44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619969.158313:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbec44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619969.158326:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbec44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619969.158338:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788619969.158456:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbec3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab4d expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619969.158476:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbec44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab4d expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619969.158485:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:2.0:1788619969.158487:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788619969.158491:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619969.158565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+31:11534:x1875503657068928:12345-192.168.203.12@tcp:101:cat.0 Request processed in 440us (730us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788619969.158573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00080000:1.0:1788619969.158757:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619969.176708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619969.176870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069056 00000100:00100000:3.0:1788619969.176884:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069056 00000100:00100000:3.0:1788619969.176966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1788619969.176979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:11535:x1875503657069056:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619969.177012:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619969.177061:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab54 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177175:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177194:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177209:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619969.177255:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788619969.177259:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619969.177281:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab54 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177341:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab54 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.177351:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619969.177354:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619969.177371:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1200, rc 0) 00000100:00100000:3.0:1788619969.177451:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+32:11535:x1875503657069056:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 474us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619969.177459:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1788619969.186706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619969.186876:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069440 00000100:00100000:2.0:1788619969.186890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069440 00000100:00100000:2.0:1788619969.186963:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788619969.186976:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11535:x1875503657069440:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619969.187524:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+33:11535:x1875503657069440:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 549us (831us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788619969.187552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788619969.189963:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619969.190067:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069568 00000100:00100000:1.0:1788619969.190084:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069568 00000100:00100000:1.0:1788619969.190182:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788619969.190192:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387307850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+33:11535:x1875503657069568:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788619969.190209:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788619969.190232:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbebe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab38 expref: 33 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619969.190255:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbec44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab4d expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619969.190271:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbeaed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaf9 expref: 31 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619969.190282:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291400) 00010000:00010000:1.0:1788619969.190294:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619969.190362:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387307850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+30:11535:x1875503657069568:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 171us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619969.190370:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788619969.197096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619969.197214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069696 00000100:00100000:1.0:1788619969.197230:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069696 00000100:00100000:1.0:1788619969.197307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1788619969.197318:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+30:11535:x1875503657069696:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:1.0:1788619969.197441:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619969.197464:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619969.197477:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788619969.197846:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788619969.197935:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+30:11535:x1875503657069696:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 618us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619969.197943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:0.0:1788619969.224441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619969.224549:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069824 00000100:00100000:3.0:1788619969.224581:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069824 00000100:00100000:3.0:1788619969.224662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:3.0:1788619969.224675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+30:11537:x1875503657069824:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619969.224703:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619969.224731:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224852:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224872:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224888:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.224921:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225277:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225287:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225295:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619969.225345:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788619969.225350:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619969.225372:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225387:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225397:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225404:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225411:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225418:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619969.225423:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225431:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225445:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619969.225449:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619969.225454:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225461:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225487:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225493:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225499:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225504:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619969.225507:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225514:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225522:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933388291100) 00010000:00010000:3.0:1788619969.225525:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619969.225527:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225533:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225575:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225592:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619969.225614:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:3.0:1788619969.225616:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619969.225620:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0e00, rc 0) 00000100:00100000:3.0:1788619969.225705:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:11537:x1875503657069824:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1032us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619969.225714:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00010000:00010000:0.0:1788619969.996074:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788619970.084835:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788619970.084844:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788619970.084911:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788619970.084918:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788619970.119270:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619970.119278:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619970.119331:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788619970.119339:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788619970.119680:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676992512:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788619970.119814:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338f83ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619970.129789:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676992512:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788619970.131803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619970.132813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657069952 00000100:00100000:0.0:1788619970.132825:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657069952 00000100:00100000:0.0:1788619970.132888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1788619970.132910:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:11548:x1875503657069952:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788619970.132941:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788619970.133041:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:11548:x1875503657069952:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 133us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619970.136457:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:1.0:1788619970.149004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.150073:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657070080 00000100:00100000:3.0:1788619970.150085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657070080 00000100:00100000:3.0:1788619970.150154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:3.0:1788619970.150163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:11548:x1875503657070080:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.150236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150264:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150276:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150283:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150305:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150330:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150337:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150343:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619970.150379:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788619970.150383:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619970.150400:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150412:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150418:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150436:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150443:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.150447:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150455:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:3.0:1788619970.150478:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619970.150484:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150658:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbec83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150674:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150681:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150687:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150693:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.150696:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150702:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff933388291100) 00010000:00010000:3.0:1788619970.150712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619970.150715:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150722:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbec8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150746:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150752:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150758:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150763:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.150766:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150789:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150796:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:3.0:1788619970.150798:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619970.150801:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.150807:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbec91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.150874:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:11548:x1875503657070080:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 712us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.150882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1788619970.153911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.153966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657070336 00000100:00100000:3.0:1788619970.153975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657070336 00000100:00100000:3.0:1788619970.154028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:3.0:1788619970.154049:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+31:11548:x1875503657070336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.154080:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619970.154103:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbec98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154198:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154212:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154224:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619970.154235:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788619970.154330:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154338:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154345:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154351:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.154355:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154368:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154378:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:3.0:1788619970.154387:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619970.154391:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154407:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbec9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154443:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbec98 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab62 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154453:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:3.0:1788619970.154462:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619970.154466:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbec98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab62 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.154478:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:3.0:1788619970.154523:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657070336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 477us (624us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788619970.154530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1788619970.158966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.159605:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657070464 00000100:00100000:3.0:1788619970.159614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657070464 00000100:00100000:3.0:1788619970.159674:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:3.0:1788619970.159685:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657070464:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788619970.159726:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788619970.159877:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657070464:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 194us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.159885:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:0.0:1788619970.165485:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619970.165562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657070720 00000100:00100000:2.0:1788619970.165573:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657070720 00000100:00100000:2.0:1788619970.165626:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:2.0:1788619970.165636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657070720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619970.165664:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619970.165666:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788619970.165694:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbec59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab54 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.165712:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619970.165717:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619970.165729:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbecad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab69 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788619970.166446:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788619970.167148:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbecb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.167165:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.167190:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.167259:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbecad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab69 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.167277:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbecb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab69 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.167287:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9333838fa600) 00010000:00010000:2.0:1788619970.167290:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619970.167293:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:2.0:1788619970.167363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+33:11548:x1875503657070720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1728us (1887us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788619970.167372:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1788619970.174596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619970.174633:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657070976 00000100:00100000:1.0:1788619970.174643:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657070976 00000100:00100000:1.0:1788619970.174715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:1.0:1788619970.174725:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+33:11548:x1875503657070976:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788619970.174836:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619970.174860:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbecb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab69 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.174878:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9333838fa600) 00010000:00010000:1.0:1788619970.174889:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619970.174910:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.174935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.174946:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175018:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175025:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175238:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175246:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175254:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175260:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619970.175264:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175272:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175282:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619970.175291:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619970.175296:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175302:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbecc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175314:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175329:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619970.175332:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175338:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175348:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9ef38b17 (ffff933390117100) 00010000:00010000:1.0:1788619970.175350:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619970.175353:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.175359:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbecc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9ef38b17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619970.175448:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657070976:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 723us (859us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788619970.175462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1788619970.184557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.184765:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657071104 00000100:00100000:3.0:1788619970.184832:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657071104 00000100:00100000:3.0:1788619970.184886:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1788619970.184897:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+32:11548:x1875503657071104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.184916:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619970.184938:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab70 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.184976:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.184990:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.185002:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.185091:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.185108:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.185117:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.185129:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788619970.185133:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0000, rc 0) 00000100:00100000:3.0:1788619970.185187:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+33:11548:x1875503657071104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 292us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.185200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:2.0:1788619970.188187:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.188254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657071360 00000100:00100000:3.0:1788619970.188275:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657071360 00000100:00100000:3.0:1788619970.188347:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:3.0:1788619970.188357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+33:11548:x1875503657071360:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.188443:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.188460:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.188473:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788619970.188812:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788619970.188822:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373157050155ns, next at 374157047724ns, rc = 0 00000004:00010000:3.0:1788619970.188910:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dca65ed reply state 000000007071e368 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.188920:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619970.189253:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+35:11548:x1875503657071360:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 894us (1074us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788619970.189261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00010000:00010000:3.0:1788619970.191250:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.191267:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.191409:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619970.191473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657071488 00000100:00100000:0.0:1788619970.191482:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657071488 00000100:00100000:0.0:1788619970.191536:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:0.0:1788619970.191546:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:11548:x1875503657071488:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619970.191568:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619970.191586:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.192111:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.194623:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.194664:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.194703:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619970.194707:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619970.194711:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788619970.194800:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+36:11548:x1875503657071488:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3254us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619970.194821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00010000:00010000:3.0:1788619970.196046:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.196064:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.196078:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.196093:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.196097:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788619970.196101:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.196108:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecde lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.199243:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.199413:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657071616 00000100:00100000:3.0:1788619970.199423:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657071616 00000100:00100000:3.0:1788619970.199503:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788619970.199517:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657071616:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788619970.199902:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657071616:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 387us (667us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788619970.199910:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00080000:2.0:1788619970.199992:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788619970.203201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619970.203261:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657071872 00000100:00100000:2.0:1788619970.203277:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657071872 00000100:00100000:2.0:1788619970.203333:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788619970.203344:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:11548:x1875503657071872:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788619970.203555:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333861c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+36:11548:x1875503657071872:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 212us (362us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788619970.203562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788619970.211907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.212350:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072128 00000100:00100000:3.0:1788619970.212361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072128 00000100:00100000:3.0:1788619970.212419:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:3.0:1788619970.212429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+36:11548:x1875503657072128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788619970.212541:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+36:11548:x1875503657072128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 112us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.212549:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788619970.216867:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.216956:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072256 00000100:00100000:3.0:1788619970.216965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072256 00000100:00100000:3.0:1788619970.217017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:3.0:1788619970.217027:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+36:11548:x1875503657072256:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.217047:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619970.217068:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab7e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217155:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217170:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217181:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619970.217216:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788619970.217232:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217257:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbecec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab7e expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217284:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab7e expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.217293:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.217296:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788619970.217300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:3.0:1788619970.217365:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+37:11548:x1875503657072256:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 340us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.217373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:1.0:1788619970.223649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.223726:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072384 00000100:00100000:3.0:1788619970.223736:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072384 00000100:00100000:3.0:1788619970.223813:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788619970.223824:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657072384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.223843:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619970.223863:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab85 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788619970.223889:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2cc2, blocks: 0x1 00010000:00010000:3.0:1788619970.223907:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1788619970.223913:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788619970.223922:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.223941:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.223955:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0600, rc 0) 00000100:00100000:3.0:1788619970.224003:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657072384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.224010:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788619970.234495:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.237804:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072640 00000100:00100000:3.0:1788619970.237820:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072640 00000100:00100000:3.0:1788619970.237891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788619970.237901:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+37:11548:x1875503657072640:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788619970.238010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+37:11548:x1875503657072640:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 110us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.238018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788619970.246385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619970.250673:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072768 00000100:00100000:2.0:1788619970.250688:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072768 00000100:00100000:2.0:1788619970.250748:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788619970.250757:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:11548:x1875503657072768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619970.250792:0:8933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619970.250811:0:8933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab8c expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.250839:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.250848:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619970.250852:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619970.250857:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 9 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.250889:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.250902:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.250916:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676992640:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619970.251013:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788619970.261154:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676992640:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619970.261204:0:8933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 9 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.261233:0:8933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb000, rc 0) 00000100:00100000:2.0:1788619970.263003:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:11548:x1875503657072768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 12235us (18995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619970.263015:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788619970.263637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619970.263725:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657072896 00000100:00100000:0.0:1788619970.263735:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657072896 00010000:00010000:0.0:1788619970.263794:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619970.263828:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788619970.263838:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657072896:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619970.263852:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619970.263873:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.263888:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.263911:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa49bda7/0xbb0e330328bbecfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab85 expref: 9 pid: 6689 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.263926:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619970.263931:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619970.263940:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.263965:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.264002:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619970.264016:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875503676992768:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788619970.264657:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181780 going to sleep for 11 seconds 00000100:00100000:3.0:1788619970.274323:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875503676992768:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788619970.274352:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619970.274450:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657072896:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 10612us (10815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.274463:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788619970.275998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.276037:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073024 00000100:00100000:3.0:1788619970.276047:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073024 00002000:00100000:3.0:1788619970.276111:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9333bc463100 x1875503657073024/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:66/0 lens 504/0 e 0 to 0 dl 1788619981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619970.276132:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc463100 with x1875503657073024 ext(0->8) 00002000:00010000:3.0:1788619970.276138:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc463100 00000100:00100000:3.0:1788619970.276174:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788619970.276184:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657073024:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788619970.277236:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+10:2354:x1875503657073024:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 466us (658us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788619970.277250:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:3.0:1788619970.277261:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9333bc463100 x1875503657073024/t4294967314(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:66/0 lens 504/448 e 0 to 0 dl 1788619981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788619970.277425:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc463100 with x1875503657073024 ext(0->8) 00002000:00010000:3.0:1788619970.277430:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc463100 00000100:00100000:2.0:1788619970.282255:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619970.282324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073152 00000100:00100000:1.0:1788619970.282335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073152 00000100:00100000:1.0:1788619970.282397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1788619970.282408:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+37:11548:x1875503657073152:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788619970.327630:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:00080000:1.0:1788619970.327650:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:1.0:1788619970.327664:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788619970.327682:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788619970.327706:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788619970.327741:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788619970.327758:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788619970.327765:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+18:11548:x1875503657073152:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 45351us (45513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.327800:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1788619970.327982:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619970.327999:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676992896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788619970.328052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619970.328113:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676992896 00000100:00100000:3.0:1788619970.328170:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676992896 00000100:00100000:3.0:1788619970.328268:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788619970.328286:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503676992896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788619970.328422:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788619970.328426:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788619971 00002000:00010000:3.0:1788619970.328429:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788619970.328431:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788619970 -> 1788619971 00002000:00010000:3.0:1788619970.328434:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788619970.328471:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676992896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (418us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788619970.328477:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1788619970.328499:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bc456300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788619970.328507:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676992896:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788619970.329367:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788619970.332286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619970.332446:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073280 00000100:00100000:1.0:1788619970.332456:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073280 00000100:00100000:1.0:1788619970.332571:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788619970.332582:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+10:2354:x1875503657073280:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788619970.363613:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788619970.363630:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788619970.363839:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657073280:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 31253us (31556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619970.363850:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788619970.367563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.367651:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073536 00000100:00100000:3.0:1788619970.367670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073536 00000100:00100000:3.0:1788619970.367729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:3.0:1788619970.367739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+18:11548:x1875503657073536:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788619970.367827:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619970.367854:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbecf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab7e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.367894:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.367911:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788619970.367944:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.367958:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.367968:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788619970.368228:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b321d7c reply state 00000000055e6aa2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.368238:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788619970.368608:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+19:11548:x1875503657073536:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 867us (1052us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788619970.368616:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00010000:00010000:3.0:1788619970.370609:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370623:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370630:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370635:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.370639:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370669:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370685:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.370688:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619970.370692:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.370699:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619970.373085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619970.373754:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073664 00000100:00100000:0.0:1788619970.373765:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073664 00000100:00100000:0.0:1788619970.373851:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788619970.373861:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657073664:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788619970.374187:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788619970.374191:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788619971 -> 1788619969 00002000:00010000:0.0:1788619970.374193:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788619968 00002000:00010000:0.0:1788619970.374195:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788619971 -> 1788619969 00002000:00010000:0.0:1788619970.374197:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788619970.374264:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657073664:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 404us (1188us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788619970.374283:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788619970.382144:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619970.382502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657073920 00000100:00100000:1.0:1788619970.382512:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657073920 00000100:00100000:1.0:1788619970.382605:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:1.0:1788619970.382617:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:11548:x1875503657073920:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788619970.382714:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.382731:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.382741:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.382807:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.382822:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 18 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619970.382837:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd244000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676993024:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619970.383094:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619970.386689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.387045:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074048 00000100:00100000:3.0:1788619970.387054:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074048 00010000:00010000:3.0:1788619970.387094:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.387143:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788619970.387153:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:2354:x1875503657074048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619970.387169:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619970.387176:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.387190:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.387213:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.387218:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.387243:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.387251:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.387283:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619970.387330:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:2354:x1875503657074048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 177us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.387337:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:2.0:1788619970.387640:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbecd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab70 expref: 18 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.387666:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd244000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676993024:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619970.387686:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387695:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387700:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387745:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387753:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387760:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387766:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619970.387793:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387802:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387812:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619970.387815:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788619970.387819:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.387825:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142400/0xbb0e330328bbed0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.387865:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+17:11548:x1875503657073920:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 5250us (5732us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788619970.387873:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:2.0:1788619970.393371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619970.393457:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074176 00000100:00100000:0.0:1788619970.393472:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074176 00000100:00100000:0.0:1788619970.393542:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788619970.393552:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657074176:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788619970.393598:0:8933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.393618:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.393628:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619970.393633:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619970.393638:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.393674:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.393688:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619970.393703:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676993152:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619970.393830:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff933398181480 going to sleep for 11 seconds 00000100:00100000:0.0:1788619970.399223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.399322:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074304 00000100:00100000:3.0:1788619970.399339:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074304 00010000:00010000:3.0:1788619970.399409:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 9 pid: 8933 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.399470:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788619970.399483:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657074304:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619970.399503:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619970.399538:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 9 pid: 8933 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.399556:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 9 pid: 8933 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.399592:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619970.399597:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619970.399606:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.399637:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.399676:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619970.399767:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657074304:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 276us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.399821:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00010000:00010000:2.0:1788619970.402836:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000792fae29/0xbb0e330328bbed01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab8c expref: 8 pid: 8933 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.402881:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8933:1875503676993152:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619970.402978:0:8933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.402992:0:8933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403000:0:8933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403144:0:8933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403153:0:8933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403162:0:8933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403169:0:8933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788619970.403174:0:8933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403184:0:8933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403210:0:8933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.403217:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbed16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.403370:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657074176:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 9817us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619970.403380:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788619970.415724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619970.415879:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074560 00000100:00100000:1.0:1788619970.415964:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074560 00000100:00100000:1.0:1788619970.416061:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1788619970.416072:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+17:11548:x1875503657074560:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788619970.416161:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416178:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416190:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416440:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416451:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416459:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416492:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.416506:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 18 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619970.416521:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676993280:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619970.418083:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788619970.424328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.424429:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074688 00000100:00100000:3.0:1788619970.424439:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074688 00010000:00010000:3.0:1788619970.424478:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.424519:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788619970.424529:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:2354:x1875503657074688:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619970.424544:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619970.424551:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.424566:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 19 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.424592:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.424598:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.424607:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.424629:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.424649:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619970.424740:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+19:2354:x1875503657074688:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 212us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.424747:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00010000:00010000:1.0:1788619970.424849:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbece5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab77 expref: 18 pid: 5840 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619970.424867:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676993280:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788619970.424888:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.424897:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619970.424903:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619970.425090:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788619970.425252:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788619970.425296:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788619970.425375:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8707:1875503676993408:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788619970.425424:0:8707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619970.425458:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788619970.425518:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676993408 00000100:00100000:3.0:1788619970.425523:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676993408 00000100:00100000:3.0:1788619970.425563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788619970.425570:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8707:x1875503676993408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788619970.425648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8707:x1875503676993408:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.425655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788619970.425764:0:8707:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788619970.425804:0:8707:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bc456300, transno 4294967315 00000100:00100000:2.0:1788619970.425817:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd247100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8707:1875503676993408:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788619970.426260:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788619970.426313:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8707:1875503676993536:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788619970.426360:0:8707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619970.426388:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390c0cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788619970.426692:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676993536 00000100:00100000:3.0:1788619970.426697:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676993536 00000100:00100000:3.0:1788619970.426733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788619970.426740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8707:x1875503676993536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788619970.426918:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8707:x1875503676993536:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (556us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788619970.426925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788619970.426958:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8707:1875503676993536:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788619970.426988:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.426997:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427015:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427022:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.427026:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427034:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427049:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619970.427052:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619970.427056:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427062:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbed24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427090:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427096:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427102:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427107:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619970.427109:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427137:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427146:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:3.0:1788619970.427148:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619970.427151:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427157:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbec60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427178:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427190:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427198:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427223:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.427236:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.427247:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676993664:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788619970.427298:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788619970.430064:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676993664:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619970.430107:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619970.431623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.432169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657074816 00000100:00100000:3.0:1788619970.432179:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657074816 00010000:00010000:3.0:1788619970.432220:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 22 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619970.432252:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1788619970.432263:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:2354:x1875503657074816:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619970.432288:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619970.432296:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 22 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432309:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 22 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432331:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbec7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab5b expref: 22 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432346:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:3.0:1788619970.432351:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432361:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432369:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619970.432415:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619970.432481:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:2354:x1875503657074816:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 219us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619970.432488:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:2.0:1788619970.432672:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432681:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432692:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432699:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432712:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432719:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619970.432723:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432730:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432740:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:2.0:1788619970.432743:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619970.432747:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432753:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1c00/0xbb0e330328bbed2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432764:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432803:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432809:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432814:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619970.432817:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432833:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432842:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933390117b00) 00010000:00010000:2.0:1788619970.432845:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788619970.432848:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.432854:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbed1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619970.433067:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+20:11548:x1875503657074560:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 16996us (17352us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788619970.433075:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000020:00080000:2.0:1788619970.433079:0:8707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788619970.433240:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619970.433245:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619970.433742:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788619970.433751:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619970.438910:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619970.439000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075072 00000100:00100000:2.0:1788619970.439010:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075072 00000100:00100000:2.0:1788619970.439066:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788619970.439075:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+20:11548:x1875503657075072:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788619970.439730:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788619970.439863:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788619970.439910:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439925:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439936:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439957:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439964:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439970:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619970.439982:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788619970.440155:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619970.440163:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.440169:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619970.440173:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.440182:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.440193:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9333838fa100) 00010000:00010000:0.0:1788619970.440197:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788619970.440201:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.440208:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619970.440225:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619970.440227:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619970.440228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619970.440263:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:11548:x1875503657075072:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1186us (1361us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788619970.440273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000020:00080000:2.0:1788619970.440278:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788619970.459606:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.459664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619970.459699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619970.459810:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075456 00000100:00100000:2.0:1788619970.459820:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075456 00000100:00100000:2.0:1788619970.459885:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:2.0:1788619970.459896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657075456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619970.459968:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657075456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619970.459976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:1.0:1788619970.460068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075200 00000100:00100000:1.0:1788619970.460073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075200 00000100:00100000:1.0:1788619970.460113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:1.0:1788619970.460133:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657075200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619970.460162:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657075200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619970.460169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:0.0:1788619970.460449:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075328 00000100:00100000:0.0:1788619970.460454:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075328 00000100:00100000:0.0:1788619970.460497:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1788619970.460505:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657075328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619970.460537:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657075328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619970.460543:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00080000:3.0:1788619970.461093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788619970.461099:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619970.759069:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676994048:0@lo:400:kworker.0 00000100:00100000:2.0:1788619970.759079:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676993920:0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.759179:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676993792:0@lo:400:kworker.0 00000100:00100000:3.0:1788619970.759226:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676994176:0@lo:400:kworker.0 00000100:00100000:0.0:1788619970.759468:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619970.759550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676994048 00000100:00100000:0.0:1788619970.759558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676994048 00000100:00100000:0.0:1788619970.759612:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788619970.759620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676994048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619970.759670:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503676994048:12345-0@lo:400:kworker.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619970.759677:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788619970.761126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619970.761209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676993920 00000100:00100000:2.0:1788619970.761217:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676993920 00000100:00100000:2.0:1788619970.761255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788619970.761264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619970.761719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503676993920:12345-0@lo:400:kworker.0 Request processed in 457us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619970.761727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788619970.762083:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503676993920:0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.762113:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788619970.762145:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619970.762164:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503676994304:0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.762201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619970.762231:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676993792 00000100:00100000:1.0:1788619970.762235:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676993792 00000100:00100000:1.0:1788619970.762268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788619970.762274:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676993792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.762318:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3312:x1875503676993792:12345-0@lo:400:kworker.0 Request processed in 44us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619970.762325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788619970.762369:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933386710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503676993792:0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.762393:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676994304 00000100:00100000:1.0:1788619970.762396:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676994304 00000100:00100000:1.0:1788619970.762422:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788619970.762428:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503676994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.762456:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503676994304:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619970.762461:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788619970.762473:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619970.762485:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503676994304:0@lo:400:kworker.0 00000100:00100000:3.0:1788619970.764134:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619970.764234:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503676994048:0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.765403:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676994176 00000100:00100000:1.0:1788619970.765413:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676994176 00000100:00100000:1.0:1788619970.765498:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788619970.765508:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676994176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619970.765591:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676994176:12345-0@lo:400:kworker.0 Request processed in 85us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619970.765597:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788619970.765692:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676994176:0@lo:400:kworker.0 00000100:00080000:2.0:1788619970.766060:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788619971.015073:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619971.273159:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788619971.273182:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676994432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619971.273251:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619971.273980:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676994432 00000100:00100000:0.0:1788619971.273991:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676994432 00000100:00100000:0.0:1788619971.274056:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788619971.274066:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676994432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619971.274091:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788619971.274168:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875503676994432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619971.274176:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788619971.274226:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676994432:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788619971.463008:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619971.463017:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619971.463374:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788619971.463380:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619971.792852:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333909dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676994560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788619971.792914:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619971.792970:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676994560 00000100:00100000:0.0:1788619971.792977:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676994560 00000100:00100000:0.0:1788619971.793013:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788619971.793020:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676994560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619971.793053:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619971.793090:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676994560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619971.793105:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788619971.793161:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333909dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676994560:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788619971.861226:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788619971.861243:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1788619972.014706:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619972.014716:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619972.014750:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788619972.014758:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788619972.040136:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619972.132010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.132189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075712 00000100:00100000:2.0:1788619972.132198:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075712 00000100:00100000:2.0:1788619972.132277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:2.0:1788619972.132287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+22:11566:x1875503657075712:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619972.132313:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619972.132336:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbed39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.132433:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbed40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.132448:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbed40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.132460:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbed40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619972.132471:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788619972.132606:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbed39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab93 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.132635:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbed40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab93 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.132656:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619972.132660:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788619972.132664:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eac00, rc 0) 00000100:00100000:2.0:1788619972.132907:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:11566:x1875503657075712:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 620us (905us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788619972.132915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00080000:1.0:1788619972.133255:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619972.140985:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.146438:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657075840 00000100:00100000:2.0:1788619972.146456:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657075840 00000100:00100000:2.0:1788619972.146585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1788619972.146596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:11566:x1875503657075840:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788619972.146689:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.146709:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.146720:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.146735:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.146742:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.146762:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147014:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147023:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147031:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619972.147074:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147087:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147094:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147101:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147115:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.147120:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147128:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147141:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619972.147151:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.147157:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147164:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147189:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147195:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147200:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147205:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.147207:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147213:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147220:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9333838fab00) 00010000:00010000:2.0:1788619972.147222:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.147225:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147230:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147242:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147253:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147263:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147268:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.147271:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147277:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147284:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9333838fa500) 00010000:00010000:2.0:1788619972.147286:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.147289:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.147295:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbed5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.149413:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+24:11566:x1875503657075840:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 2805us (8425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.149428:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1788619972.231687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619972.231754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657076096 00000100:00100000:3.0:1788619972.231764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657076096 00000100:00100000:3.0:1788619972.231937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:3.0:1788619972.231949:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:11569:x1875503657076096:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619972.231969:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619972.231990:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbed63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ab9a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232092:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232117:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232129:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232161:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232169:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232176:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232441:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232450:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232458:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619972.232467:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788619972.232555:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232563:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232570:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232576:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619972.232581:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232599:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232611:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:3.0:1788619972.232614:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619972.232619:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232624:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbed6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232636:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232642:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232648:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232653:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619972.232656:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232661:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232667:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933388291100) 00010000:00010000:3.0:1788619972.232670:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619972.232673:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232689:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbed71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232730:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbed63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232745:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.232753:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619972.232755:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788619972.232757:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0200, rc 0) 00000100:00100000:3.0:1788619972.233384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:11569:x1875503657076096:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1435us (1711us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788619972.233394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:1.0:1788619972.243938:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.244018:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657076224 00000100:00100000:2.0:1788619972.244028:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657076224 00000100:00100000:2.0:1788619972.244097:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1788619972.244115:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+26:11569:x1875503657076224:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788619972.244202:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244219:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244230:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244256:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244262:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244269:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244276:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.244280:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244290:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244302:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:2.0:1788619972.244305:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619972.244310:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.244317:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.244402:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+26:11569:x1875503657076224:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 296us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.244411:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:1.0:1788619972.248350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.248439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657076480 00000100:00100000:2.0:1788619972.248449:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657076480 00000100:00100000:2.0:1788619972.248558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788619972.248569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:11569:x1875503657076480:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619972.248845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+27:11569:x1875503657076480:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 277us (505us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788619972.248854:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788619972.294621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.294901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657076736 00000100:00100000:2.0:1788619972.294912:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657076736 00000100:00100000:2.0:1788619972.295019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:2.0:1788619972.295030:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+27:11095:x1875503657076736:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619972.295054:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619972.295076:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aba1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.295200:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.295215:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.295225:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.295275:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.295289:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 28 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.295302:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676994688:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619972.295403:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788619972.307686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.307910:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676994688:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619972.307939:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.309341:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657076864 00000100:00100000:1.0:1788619972.309352:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657076864 00010000:00010000:1.0:1788619972.309394:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 29 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.309440:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1788619972.309449:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+29:2355:x1875503657076864:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619972.309465:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619972.309471:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 29 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309484:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 29 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309506:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbed78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab9a expref: 29 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309543:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:1.0:1788619972.309549:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309569:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309577:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.309608:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619972.309661:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+28:2355:x1875503657076864:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 212us (1992us total) trans 0 rc 0/0 00010000:00010000:2.0:1788619972.309666:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.309667:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:2.0:1788619972.309683:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619972.309701:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788619972.309874:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb400/0xbb0e330328bbed8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.309889:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.309896:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:2.0:1788619972.309898:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788619972.309907:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6ebe00, rc 0) 00000100:00100000:2.0:1788619972.309935:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+28:11095:x1875503657076736:12345-192.168.203.12@tcp:101:bash.0 Request processed in 14907us (15324us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788619972.309941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1788619972.312749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.312904:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077120 00000100:00100000:2.0:1788619972.312915:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077120 00000100:00100000:2.0:1788619972.312965:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1788619972.312974:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:11095:x1875503657077120:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788619972.313224:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.313240:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.313252:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788619972.313302:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788619972.313327:0:8707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000435304ad reply state 00000000e3bf6651 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.313336:0:8707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788619972.313377:0:8707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788619972.314592:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+32:11095:x1875503657077120:12345-192.168.203.12@tcp:36:bash.0 Request processed in 1609us (1845us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788619972.314603:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000020:00080000:2.0:1788619972.314609:0:8707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788619972.322045:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788619972.322854:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322871:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322879:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322884:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619972.322889:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322917:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322935:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619972.322939:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619972.322944:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.322950:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbeda2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619972.325750:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077248 00000100:00100000:0.0:1788619972.325764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077248 00000100:00100000:0.0:1788619972.325961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1788619972.325972:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:11095:x1875503657077248:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619972.325996:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619972.326016:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeda9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aba8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.326076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeda9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba8 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.326092:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeda9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba8 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.326123:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:0.0:1788619972.326127:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619972.326130:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3c00, rc 0) 00000100:00100000:0.0:1788619972.326198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+32:11095:x1875503657077248:12345-192.168.203.12@tcp:101:bash.0 Request processed in 226us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619972.326205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1788619972.331175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.331257:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077376 00000100:00100000:2.0:1788619972.331267:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077376 00000100:00100000:2.0:1788619972.331388:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788619972.331398:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:11095:x1875503657077376:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619972.331415:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619972.331435:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abaf expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619972.331474:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c2cc1, atime: 0x6a9c2cc0, ctime: 0x6a9c2cc1, blocks: 0xb 00010000:00010000:2.0:1788619972.331497:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788619972.331503:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619972.331510:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.331527:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.331540:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338a6eb400, rc 0) 00000100:00100000:2.0:1788619972.331605:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:11095:x1875503657077376:12345-192.168.203.12@tcp:101:bash.0 Request processed in 208us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.331612:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00080000:3.0:1788619972.339098:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788619972.339492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619972.339570:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077504 00000100:00100000:3.0:1788619972.339580:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077504 00002000:00010000:3.0:1788619972.339623:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788619972.339628:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd2a8380 with x1875503657077504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788619972.339639:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bd2a8380. 00000100:00100000:3.0:1788619972.339682:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788619972.339692:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657077504:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:3.0:1788619972.339997:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788619972.340001:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788619969 -> 1788619973 00002000:00010000:3.0:1788619972.340004:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788619968 -> 1788619968 00002000:00010000:3.0:1788619972.340007:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788619969 -> 1788619973 00002000:00010000:3.0:1788619972.340009:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788619972.340063:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657077504:12345-192.168.203.12@tcp:10:bash.0 Request processed in 372us (575us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788619972.340071:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00002000:00010000:3.0:1788619972.340082:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788619972.340085:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd2a8380 with x1875503657077504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788619972.340090:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bd2a8380. 00000100:00100000:2.0:1788619972.476945:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619972.477045:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077632 00000100:00100000:1.0:1788619972.477056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077632 00000100:00100000:1.0:1788619972.477130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1788619972.477140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11583:x1875503657077632:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788619972.477214:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477233:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477245:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477279:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477287:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477294:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477546:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477562:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788619972.477600:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477612:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477619:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477626:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477632:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619972.477636:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477652:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477664:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619972.477667:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619972.477672:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477678:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142a00/0xbb0e330328bbedb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477691:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477697:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477703:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477709:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619972.477711:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477717:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477723:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933390117300) 00010000:00010000:1.0:1788619972.477726:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619972.477728:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477743:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbedbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477757:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477762:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477767:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477827:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619972.477830:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477836:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477844:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:1.0:1788619972.477847:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619972.477850:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619972.477856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbedc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.477941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+32:11583:x1875503657077632:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 801us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619972.477949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1788619972.552259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.552407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657077888 00000100:00100000:2.0:1788619972.552418:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657077888 00000100:00100000:2.0:1788619972.552494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788619972.552505:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+32:11587:x1875503657077888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619972.552537:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619972.552560:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbedcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abb6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552655:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552670:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552681:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552711:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552719:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.552727:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553014:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbede1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553025:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbede1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553032:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbede1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619972.553044:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788619972.553155:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553163:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553176:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553182:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eb600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.553187:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553206:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619972.553209:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.553214:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553221:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb600/0xbb0e330328bbedd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553233:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553239:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553245:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553249:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.553252:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553269:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553278:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9333838faf00) 00010000:00010000:2.0:1788619972.553280:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.553283:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553288:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbedda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eb000/0xbb0e330328bbedcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abb6 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553340:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbede1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abb6 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.553346:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:2.0:1788619972.553348:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788619972.553351:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6200, rc 0) 00000100:00100000:2.0:1788619972.553421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+34:11587:x1875503657077888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 919us (1174us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788619972.553429:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788619972.556718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619972.557014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657078016 00000100:00100000:1.0:1788619972.557024:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657078016 00000100:00100000:0.0:1788619972.557414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:0.0:1788619972.557427:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+34:11587:x1875503657078016:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788619972.557508:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.557526:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.557537:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.557578:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.557593:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 34 pid: 5842 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619972.557607:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676994816:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619972.557744:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788619972.567589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619972.569031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657078272 00000100:00100000:3.0:1788619972.569043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657078272 00000100:00100000:2.0:1788619972.569126:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676994816:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619972.569160:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619972.569264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788619972.569275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:5594:x1875503657078272:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788619972.569599:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+36:5594:x1875503657078272:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 325us (2020us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788619972.569607:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788619972.578572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619972.578898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657078400 00000100:00100000:3.0:1788619972.578908:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657078400 00010000:00010000:3.0:1788619972.578950:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 36 pid: 5842 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619972.578990:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1788619972.579000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387306850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+36:2354:x1875503657078400:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619972.579015:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619972.579022:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 36 pid: 5842 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579038:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 36 pid: 5842 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579060:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ebe00/0xbb0e330328bbed94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba1 expref: 36 pid: 5842 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579093:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:3.0:1788619972.579099:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579117:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579124:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.579158:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619972.579220:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387306850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:2354:x1875503657078400:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 220us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619972.579227:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00010000:00010000:2.0:1788619972.579540:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.579567:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.579596:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.579603:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.579620:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.579626:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.579630:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.580013:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.580024:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:2.0:1788619972.580027:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619972.580032:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.580038:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbedef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.580089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+34:11587:x1875503657078016:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 22664us (23379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.580097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1788619972.585961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619972.586102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657078656 00000100:00100000:0.0:1788619972.586122:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657078656 00000100:00100000:0.0:1788619972.586183:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788619972.586194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+34:11587:x1875503657078656:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619972.586453:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+35:11587:x1875503657078656:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 260us (501us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788619972.586476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1788619972.726041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619972.726145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657078912 00000100:00100000:0.0:1788619972.726156:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657078912 00000100:00100000:0.0:1788619972.726228:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:0.0:1788619972.726240:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+35:11598:x1875503657078912:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788619972.726282:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619972.726305:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbedf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726390:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726405:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726417:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726432:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726449:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726456:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726713:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbee0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726735:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbee0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726743:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbee0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619972.726752:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788619972.726877:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726885:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726891:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726898:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619972.726902:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726910:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726922:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619972.726925:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619972.726930:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726936:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbedfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726949:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726961:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726967:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726972:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619972.726975:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726982:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.726989:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385ac00) 00010000:00010000:0.0:1788619972.726992:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619972.726994:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.727001:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.727046:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbedf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abbd expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.727060:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbee0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abbd expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.727067:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:0.0:1788619972.727069:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619972.727078:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788619972.727159:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+37:11598:x1875503657078912:12345-192.168.203.12@tcp:101:cat.0 Request processed in 920us (1127us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788619972.727167:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:1.0:1788619972.737037:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619972.737191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657079168 00000100:00100000:0.0:1788619972.737201:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657079168 00000100:00100000:0.0:1788619972.737262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788619972.737273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+37:11598:x1875503657079168:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788619972.738385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+38:11598:x1875503657079168:12345-192.168.203.12@tcp:35:cat.0 Request processed in 1108us (1352us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788619972.738395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1788619972.766466:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.766962:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657079424 00000100:00100000:2.0:1788619972.766974:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657079424 00000100:00100000:2.0:1788619972.767083:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1788619972.767094:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+38:11599:x1875503657079424:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1788619972.767164:0:8707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788619972.767190:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbee0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abbd expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767225:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbede1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abb6 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767238:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeda9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aba8 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767249:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933388291b00) 00010000:00010000:2.0:1788619972.767260:0:8707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619972.767288:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767302:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767312:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767326:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767332:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767357:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767587:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767596:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.767603:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788619972.768256:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788619972.768267:0:8707:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375736494351ns, next at 376736492153ns, rc = 0 00010000:00010000:2.0:1788619972.768324:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768335:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768344:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768352:0:8707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768358:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768364:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768586:0:8707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788619972.768607:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768614:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768620:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768626:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.768630:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768638:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768649:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9333838fac00) 00010000:00010000:2.0:1788619972.768653:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788619972.768656:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768662:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768679:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768685:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768690:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768701:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.768704:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768710:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768734:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619972.768736:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.768740:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.768745:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619972.768756:0:8707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a69ddb49 reply state 0000000069793de3 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.768765:0:8707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619972.768917:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+37:11599:x1875503657079424:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1821us (2457us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788619972.768925:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00010000:00010000:0.0:1788619972.769871:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619972.769881:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.769890:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619972.769894:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.769903:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.769914:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9333838fac00) 00010000:00010000:0.0:1788619972.769917:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788619972.769921:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.769928:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6000/0xbb0e330328bbee2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.770399:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619972.770402:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619972.770404:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619972.776530:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776547:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776556:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776581:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619972.776587:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776595:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776612:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9333838faf00) 00010000:00010000:2.0:1788619972.776616:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619972.776621:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.776627:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6800/0xbb0e330328bbee20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.810964:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619972.811087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657079680 00000100:00100000:0.0:1788619972.811097:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657079680 00000100:00100000:0.0:1788619972.811523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:0.0:1788619972.811534:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+36:11605:x1875503657079680:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619972.811559:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619972.811583:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbee35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abc4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813288:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813308:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813319:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813338:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813344:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.813350:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619972.814610:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788619972.815220:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815235:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815246:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815289:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815295:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815301:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619972.815305:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815312:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815324:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619972.815328:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619972.815332:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815338:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619972.815362:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7cb8317 reply state 000000002d91dd8e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619972.815371:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788619972.815406:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbee35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815421:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.815429:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:0.0:1788619972.815431:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619972.815433:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2800, rc 0) 00000100:00100000:0.0:1788619972.815506:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+39:11605:x1875503657079680:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3974us (4550us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788619972.815514:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00010000:00010000:3.0:1788619972.818402:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818418:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818425:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818431:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619972.818436:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818443:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818475:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385ac00) 00010000:00010000:3.0:1788619972.818478:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619972.818482:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619972.818488:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbee43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619972.822382:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619972.822433:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657079808 00000100:00100000:0.0:1788619972.822444:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657079808 00000100:00100000:0.0:1788619972.822583:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00080000:3.0:1788619972.822595:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619972.822597:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2357:x1875503657079808:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619972.822616:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619972.822638:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abcb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788619972.822666:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788619972.822699:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1788619972.822935:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619972.822947:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.822970:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619972.822984:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2200, rc 0) 00000100:00100000:1.0:1788619972.823228:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2357:x1875503657079808:12345-192.168.203.12@tcp:101:bash.0 Request processed in 633us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619972.823238:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788619972.828705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.828806:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657079936 00000100:00100000:2.0:1788619972.828818:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657079936 00000100:00100000:2.0:1788619972.828878:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788619972.828888:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+6:11605:x1875503657079936:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619972.828906:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619972.828925:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abd2 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.828958:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.828967:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619972.828971:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619972.828991:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.829028:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.829042:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.829058:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1875503676994944:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619972.829159:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619972.832277:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1875503676994944:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619972.832313:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.832335:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6800, rc 0) 00000100:00100000:2.0:1788619972.832394:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:11605:x1875503657079936:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3506us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.832402:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788619972.833286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619972.833357:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657080064 00000100:00100000:2.0:1788619972.833365:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657080064 00010000:00010000:2.0:1788619972.833396:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.833435:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788619972.833454:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657080064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619972.833480:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619972.833501:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.833515:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.833536:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbee58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abcb expref: 7 pid: 6692 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.833550:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619972.833555:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619972.833563:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.833572:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619972.833603:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619972.833616:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875503676995072:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788619972.833682:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788619972.840353:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619972.840437:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657080320 00000100:00100000:3.0:1788619972.840454:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657080320 00000100:00100000:3.0:1788619972.840511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788619972.840520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+38:11605:x1875503657080320:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788619972.840884:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+39:11605:x1875503657080320:12345-192.168.203.12@tcp:35:bash.0 Request processed in 364us (540us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788619972.840892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788619972.841303:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875503676995072:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788619972.841325:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619972.841378:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+6:2355:x1875503657080064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 7933us (8093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619972.841387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788619973.003111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.003221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657080448 00000100:00100000:0.0:1788619973.003232:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657080448 00000100:00100000:0.0:1788619973.003359:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:0.0:1788619973.003371:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+39:11621:x1875503657080448:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619973.003396:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619973.003418:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abd9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003483:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003498:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003509:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619973.003542:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788619973.003546:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619973.003561:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003602:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbee66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd9 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003830:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd9 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.003840:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619973.003842:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619973.003846:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2200, rc 0) 00000100:00100000:0.0:1788619973.003950:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+40:11621:x1875503657080448:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 580us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.003957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:1.0:1788619973.007545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.008498:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657080704 00000100:00100000:2.0:1788619973.008509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657080704 00000100:00100000:2.0:1788619973.008626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788619973.008645:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+40:11621:x1875503657080704:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619973.008665:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.008687:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abe0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.008804:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.008820:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.008831:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.008843:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788619973.008973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbee74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe0 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.008991:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe0 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.009000:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:2.0:1788619973.009003:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619973.009018:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6600, rc 0) 00000100:00100000:2.0:1788619973.009079:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+42:11621:x1875503657080704:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 445us (1544us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788619973.009087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1788619973.013260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.013411:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657080832 00000100:00100000:3.0:1788619973.013423:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657080832 00000100:00100000:3.0:1788619973.013498:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788619973.013508:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+42:2357:x1875503657080832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.013524:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.013549:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6600/0xbb0e330328bbee7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe0 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.013569:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:3.0:1788619973.013576:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.013666:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+41:2357:x1875503657080832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 158us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.013673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788619973.016053:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.016250:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081088 00000100:00100000:2.0:1788619973.016267:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081088 00000100:00100000:2.0:1788619973.016316:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1788619973.016325:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+41:11621:x1875503657081088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619973.016346:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.016365:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbee89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abe7 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.016456:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.016472:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.016483:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.016494:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788619973.016846:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbee89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe7 expref: 44 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.016864:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe7 expref: 43 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.016874:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:2.0:1788619973.016890:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788619973.016894:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7800, rc 0) 00000100:00100000:2.0:1788619973.016991:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+43:11621:x1875503657081088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 667us (945us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788619973.016998:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:1.0:1788619973.027418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.027491:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081216 00000100:00100000:2.0:1788619973.027502:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081216 00000100:00100000:2.0:1788619973.027557:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788619973.027568:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb9d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+6:2354:x1875503657081216:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:2.0:1788619973.027622:0:8933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.027649:0:8933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.027658:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619973.027662:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788619973.027667:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.027704:0:8933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.027720:0:8933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 6 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.027733:0:8933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8933:1875503676995200:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619973.027881:0:8933:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619973.030751:0:8933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8933:1875503676995200:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619973.030835:0:8933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.031369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.031926:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081344 00000100:00100000:2.0:1788619973.031935:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081344 00002000:00100000:2.0:1788619973.031983:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9333bd2a8e00 x1875503657081344/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:69/0 lens 504/0 e 0 to 0 dl 1788619984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788619973.031992:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd2a8e00 with x1875503657081344 ext(0->8) 00010000:00010000:2.0:1788619973.032000:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 7 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.032014:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 7 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619973.032023:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bd2a8e00 00000100:00100000:2.0:1788619973.032055:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788619973.032064:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657081344:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:2.0:1788619973.033125:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657081344:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1050us (1745us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788619973.033135:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:2.0:1788619973.033144:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9333bd2a8e00 x1875503657081344/t4294967308(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:69/0 lens 504/448 e 0 to 0 dl 1788619984 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788619973.033153:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd2a8e00 with x1875503657081344 ext(0->8) 00010000:00010000:2.0:1788619973.033166:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.033181:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619973.033188:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9333bd2a8e00 00000100:00100000:1.0:1788619973.047027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.048598:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081472 00000100:00100000:0.0:1788619973.048612:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081472 00010000:00010000:0.0:1788619973.048660:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.048707:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788619973.048717:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657081472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619973.048733:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788619973.048751:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788619973.048754:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788619973 00002000:00010000:0.0:1788619973.048757:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788619973 00002000:00010000:0.0:1788619973.048759:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788619973 00010000:00010000:0.0:1788619973.048766:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.049045:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.049070:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072fe8638/0xbb0e330328bbee5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd2 expref: 9 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.049086:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788619973.049090:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1788619973.049096:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.049115:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.049151:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619973.049197:0:8933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049209:0:8933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049233:0:8933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049243:0:8933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049252:0:8933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.049254:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2354:x1875503657081472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 537us (2236us total) trans 0 rc 0/0 00010000:00010000:2.0:1788619973.049266:0:8933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7400 already unused, calling callback (ffffffffc148e4f0) 00000100:00100000:0.0:1788619973.049271:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:2.0:1788619973.049274:0:8933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049284:0:8933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049303:0:8933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.049311:0:8933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbee9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.049355:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb9d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657081216:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 21790us (21945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.049363:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788619973.052960:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.053038:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081728 00000100:00100000:3.0:1788619973.053050:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081728 00000100:00100000:3.0:1788619973.053119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788619973.053130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+43:11621:x1875503657081728:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:3.0:1788619973.053195:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe7 expref: 43 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788619973.053579:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788619973.053759:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788619973.054447:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788619973.054509:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.054527:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.054536:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.054576:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.054593:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 47 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.054619:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875503676995328:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619973.054721:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788619973.057577:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875503676995328:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619973.057702:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.059557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.059855:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081856 00000100:00100000:3.0:1788619973.059866:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081856 00010000:00010000:3.0:1788619973.059909:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 48 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.059953:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788619973.059963:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+48:2355:x1875503657081856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.059979:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.059986:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 48 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060000:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 48 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060021:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbee4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abc4 expref: 48 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060056:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:3.0:1788619973.060062:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060071:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060079:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.060115:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.060170:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+47:2355:x1875503657081856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 207us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.060177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:2.0:1788619973.060246:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.060264:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788619973.060385:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788619973.060591:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788619973.060707:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875503676995456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788619973.060751:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619973.060809:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788619973.061389:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676995456 00000100:00100000:3.0:1788619973.061396:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676995456 00000100:00100000:3.0:1788619973.061466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788619973.061475:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875503676995456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788619973.061559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875503676995456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.061567:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788619973.061626:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619973.061734:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788619973.061740:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788619973.061758:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff933285bfbb80, transno 4294967307 00000100:00100000:0.0:1788619973.061806:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875503676995456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788619973.062750:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1788619973.063017:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619973.063127:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875503676995584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788619973.063183:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619973.063216:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788619973.063872:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676995584 00000100:00100000:3.0:1788619973.063882:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676995584 00000100:00100000:3.0:1788619973.063937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788619973.063946:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875503676995584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788619973.064166:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875503676995584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (981us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788619973.064188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788619973.065191:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875503676995584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788619973.065508:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788619973.065561:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.065573:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.065580:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.065586:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.065590:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.065598:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.065625:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:0.0:1788619973.065628:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788619973.066107:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.066118:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbeea5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788619973.066539:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788619973.066751:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788619973.066918:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376035145328ns, next at 377035142448ns, rc = 0 00000001:00080000:0.0:1788619973.066928:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788619973.066977:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93338385a300) 00010000:00010000:0.0:1788619973.066981:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788619973.066990:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbee90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abe7 expref: 51 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.067164:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:11621:x1875503657081728:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 14035us (14213us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788619973.067173:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00080000:0.0:1788619973.067178:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788619973.070489:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.071112:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657081984 00000100:00100000:3.0:1788619973.071122:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657081984 00000100:00100000:3.0:1788619973.071183:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:3.0:1788619973.071194:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+50:11621:x1875503657081984:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619973.071230:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619973.071371:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbeeac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.071543:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbeeac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abee expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.071558:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbeeac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abee expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.071579:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.071583:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788619973.071587:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:3.0:1788619973.071702:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+51:11621:x1875503657081984:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 509us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.071709:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1788619973.080171:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.080571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657082240 00000100:00100000:0.0:1788619973.080582:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657082240 00000100:00100000:0.0:1788619973.080849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788619973.080860:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+51:11621:x1875503657082240:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788619973.081140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+52:11621:x1875503657082240:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 281us (978us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788619973.081147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788619973.204077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.204181:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657082368 00000100:00100000:0.0:1788619973.204191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657082368 00000100:00100000:0.0:1788619973.204258:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1788619973.204268:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+52:11631:x1875503657082368:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788619973.204354:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204371:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204399:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204415:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204423:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204429:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204521:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204539:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204547:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788619973.204588:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204600:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204607:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204613:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204629:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.204634:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204650:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619973.204666:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.204670:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeeb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204688:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204694:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204699:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204704:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.204706:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204711:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204730:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385a300) 00010000:00010000:0.0:1788619973.204732:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.204735:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204740:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeeba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204753:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204757:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204763:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204767:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.204830:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204837:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204844:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.204846:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.204849:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.204854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.204932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+52:11631:x1875503657082368:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 664us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.204940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:1.0:1788619973.237109:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.237225:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657082624 00000100:00100000:2.0:1788619973.237237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657082624 00000100:00100000:2.0:1788619973.237315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:2.0:1788619973.237326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+52:11634:x1875503657082624:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619973.237364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.237388:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbeec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abf5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237472:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237488:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237541:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237558:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237675:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237683:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.237689:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.237699:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788619973.238330:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238340:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238358:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238363:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.238375:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238383:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238396:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619973.238399:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619973.238500:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238509:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7200/0xbb0e330328bbeecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238523:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238528:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238533:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238538:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.238541:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238547:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238556:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9333838faf00) 00010000:00010000:2.0:1788619973.238559:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619973.238574:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238579:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbeed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238623:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbeec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238636:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.238643:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.238645:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619973.238648:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6400, rc 0) 00000100:00100000:2.0:1788619973.238968:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+54:11634:x1875503657082624:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1635us (1870us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788619973.238977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1788619973.248175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.248351:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657082752 00000100:00100000:0.0:1788619973.248372:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657082752 00000100:00100000:0.0:1788619973.248442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:0.0:1788619973.248459:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+54:11634:x1875503657082752:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788619973.248534:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248552:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248563:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248588:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248595:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248601:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248607:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.248611:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248619:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.248648:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788619973.248652:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.248661:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbeeeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.248734:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+54:11634:x1875503657082752:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 281us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.248742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1788619973.252506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.252612:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083008 00000100:00100000:2.0:1788619973.252623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083008 00000100:00100000:2.0:1788619973.252686:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788619973.252697:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+54:11634:x1875503657083008:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788619973.252957:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+55:11634:x1875503657083008:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 261us (458us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788619973.252965:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788619973.334655:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.334767:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083264 00000100:00100000:0.0:1788619973.334821:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083264 00000100:00100000:0.0:1788619973.334902:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1788619973.334914:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+55:11644:x1875503657083264:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788619973.334948:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619973.334952:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788619973.334989:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbee6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abd9 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335014:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619973.335021:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788619973.335038:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeef2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06abfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335183:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335223:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335233:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335297:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.335314:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 55 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.335331:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676995712:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619973.335449:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.340131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.340243:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083392 00000100:00100000:2.0:1788619973.340257:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083392 00010000:00010000:2.0:1788619973.340315:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 56 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.340386:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788619973.340398:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+56:2355:x1875503657083392:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619973.340419:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619973.340428:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 56 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.340449:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 56 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.340480:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.340486:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.340498:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.340507:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.340519:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6400/0xbb0e330328bbeedd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abf5 expref: 56 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.340531:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619973.340538:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676995712:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.340568:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.340578:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.340584:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619973.340611:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:2.0:1788619973.340649:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+55:2355:x1875503657083392:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 253us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.340658:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00010000:00010000:0.0:1788619973.341426:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbeef2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.341451:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.341460:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.341464:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619973.341467:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3c00, rc 0) 00000100:00100000:0.0:1788619973.341512:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+55:11644:x1875503657083264:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6601us (6881us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788619973.341520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1788619973.344651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.344955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083648 00000100:00100000:0.0:1788619973.344970:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083648 00000100:00100000:0.0:1788619973.345092:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:0.0:1788619973.345114:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+55:11644:x1875503657083648:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788619973.345511:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.345536:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.345550:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788619973.345615:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788619973.346128:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000617d57ca reply state 0000000091e371df transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.346142:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788619973.346293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+58:11644:x1875503657083648:12345-192.168.203.12@tcp:36:bash.0 Request processed in 1179us (1663us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788619973.346303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000020:00080000:0.0:1788619973.346310:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788619973.349433:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788619973.350306:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350324:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350333:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350361:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619973.350367:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350376:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350398:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.350402:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619973.350409:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.350416:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbef07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.350787:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083776 00000100:00100000:2.0:1788619973.350803:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083776 00000100:00100000:2.0:1788619973.350890:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1788619973.350903:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+57:11644:x1875503657083776:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788619973.350947:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.350970:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac03 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.351094:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.351122:0:8707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.351131:0:8707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.351177:0:8707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.351191:0:8707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 58 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.351208:0:8707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676995840:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619973.353359:0:8707:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.356028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.356117:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657083904 00000100:00100000:3.0:1788619973.356131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657083904 00010000:00010000:3.0:1788619973.356190:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 59 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.356238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1788619973.356260:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+59:2354:x1875503657083904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.356281:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.356290:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 59 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.356307:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 59 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.356362:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.356369:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.356381:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.356390:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.356414:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.356485:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+59:2354:x1875503657083904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 237us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.356494:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00010000:00010000:2.0:1788619973.358137:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbeef9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abfc expref: 58 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.358168:0:8707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8707:1875503676995840:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619973.358201:0:8707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.358239:0:8707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.358245:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.358389:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788619973.358395:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619973.358422:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.358470:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 58 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.358487:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 57 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.358497:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.358500:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619973.358505:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6c00, rc 0) 00000100:00100000:2.0:1788619973.358645:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+57:11644:x1875503657083776:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7745us (9226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.358655:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:1.0:1788619973.362357:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.362468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084160 00000100:00100000:2.0:1788619973.362482:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084160 00000100:00100000:2.0:1788619973.362603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788619973.362615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+57:11644:x1875503657084160:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788619973.362956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+58:11644:x1875503657084160:12345-192.168.203.12@tcp:35:bash.0 Request processed in 341us (613us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788619973.362983:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788619973.417489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.417973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084288 00000100:00100000:2.0:1788619973.417989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084288 00000100:00100000:2.0:1788619973.418125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1788619973.418140:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+58:11650:x1875503657084288:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788619973.418180:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.418212:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac0a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418305:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418339:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.418515:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788619973.418520:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619973.418545:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418576:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac0a expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418602:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac0a expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.418876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619973.418882:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619973.418887:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7600, rc 0) 00000100:00100000:2.0:1788619973.418975:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657084288:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 838us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.418983:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:1.0:1788619973.426697:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.427087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084416 00000100:00100000:0.0:1788619973.427112:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084416 00000100:00100000:0.0:1788619973.427227:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1788619973.427239:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657084416:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619973.427267:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619973.427296:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427387:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427405:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427419:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427435:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427442:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427448:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427595:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427603:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619973.427650:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788619973.427655:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619973.427678:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427691:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427700:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427707:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427729:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427737:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.427741:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427750:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427764:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619973.427768:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.427810:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.427817:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3a00/0xbb0e330328bbef31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428128:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428137:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428144:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428149:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.428153:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428159:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428167:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93338385a300) 00010000:00010000:0.0:1788619973.428169:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.428172:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428178:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428220:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428251:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.428260:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.428262:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619973.428265:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:0.0:1788619973.428464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+60:11650:x1875503657084416:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1122us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.428475:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1788619973.431889:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.432057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084672 00000100:00100000:0.0:1788619973.432072:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084672 00000100:00100000:0.0:1788619973.432152:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788619973.432164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+60:11650:x1875503657084672:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788619973.432193:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619973.432221:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432505:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432525:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 61 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432534:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432567:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432612:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432629:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.432645:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676995968:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.432814:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 61 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.432823:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 61 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.432832:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676996096:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619973.432858:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.442692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.442820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.443093:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084800 00000100:00100000:3.0:1788619973.443118:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084800 00010000:00010000:3.0:1788619973.443180:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 62 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.443237:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657084928 00000100:00100000:3.0:1788619973.443241:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657084928 00010000:00010000:3.0:1788619973.443258:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 63 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.443284:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788619973.443295:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387305850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+63:2355:x1875503657084800:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.443315:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.443324:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 63 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443357:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 63 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443477:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.443484:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443495:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443502:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.443574:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387305850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+63:2355:x1875503657084800:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 280us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.443582:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788619973.443650:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788619973.443658:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+62:2355:x1875503657084928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.443667:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.443673:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 62 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443684:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 62 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443696:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.443700:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443720:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443730:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.443754:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.443815:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+62:2355:x1875503657084928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 157us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.443822:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00010000:00010000:0.0:1788619973.444743:0:5841:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.12@tcp) returned -22 from blocking AST (req@000000001b027850 x1875503676995968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.444764:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbef3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac11 expref: 61 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.445559:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676995968:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.445609:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbef15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac03 expref: 60 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.445621:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676996096:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.445656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.445668:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.445679:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.445686:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619973.445719:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788619973.446810:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.446839:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.446849:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.446853:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619973.446856:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3c00, rc 0) 00000100:00100000:0.0:1788619973.446946:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+60:11650:x1875503657084672:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 14775us (15060us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788619973.446956:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:1.0:1788619973.452712:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.453444:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085184 00000100:00100000:3.0:1788619973.453461:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085184 00000100:00100000:3.0:1788619973.453632:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788619973.453646:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+60:11650:x1875503657085184:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:3.0:1788619973.453668:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.453705:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbeeac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abee expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.453732:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.453739:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.453876:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657085184:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 232us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.453884:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788619973.460588:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.460950:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085312 00000100:00100000:2.0:1788619973.460966:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085312 00000100:00100000:2.0:1788619973.461038:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1788619973.461052:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657085312:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1788619973.461205:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.461228:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.461243:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788619973.461467:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788619973.462262:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657085312:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 665us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.462277:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1788619973.481446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.481839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085440 00000100:00100000:0.0:1788619973.482281:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085440 00000100:00100000:1.0:1788619973.482468:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:1.0:1788619973.482482:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+59:11650:x1875503657085440:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619973.482517:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619973.482546:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482628:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482642:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482667:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482694:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482710:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:1.0:1788619973.482714:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788619973.482718:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.482726:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143200, rc 0) 00000100:00100000:1.0:1788619973.483109:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+60:11650:x1875503657085440:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 618us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.483118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000040:00080000:1.0:1788619973.512501:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619973.513425:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619973.515590:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788619973.515619:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788619973.520811:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676996224:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788619973.520973:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.525622:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676996224:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788619973.528593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.528720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085568 00000100:00100000:0.0:1788619973.528734:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085568 00000100:00100000:0.0:1788619973.529411:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:0.0:1788619973.529427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+60:11651:x1875503657085568:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788619973.529471:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788619973.529621:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+60:11651:x1875503657085568:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 199us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.529634:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:2.0:1788619973.533596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.533707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085696 00000100:00100000:0.0:1788619973.533769:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085696 00000100:00100000:0.0:1788619973.533884:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:0.0:1788619973.533896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+60:11651:x1875503657085696:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788619973.535234:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535279:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535307:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535314:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535378:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535397:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788619973.535769:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788619973.535850:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788619973.535869:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535883:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535891:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535900:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535907:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.535912:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.535920:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536128:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:0.0:1788619973.536144:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.536152:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536160:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2c00/0xbb0e330328bbef69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536181:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536187:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536193:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536198:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.536202:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536209:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536217:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93338385a300) 00010000:00010000:0.0:1788619973.536220:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.536223:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536229:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2e00/0xbb0e330328bbef70 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536246:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536259:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536265:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536270:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788619973.536274:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536280:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536288:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619973.536290:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619973.536293:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.536299:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbef77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.536860:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+60:11651:x1875503657085696:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 2956us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.536873:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:1.0:1788619973.543306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.543575:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657085952 00000100:00100000:2.0:1788619973.543590:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657085952 00000100:00100000:2.0:1788619973.543892:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1788619973.543904:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+60:11651:x1875503657085952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.543999:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.544116:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbef7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac26 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.544282:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.544303:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.544317:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.544337:0:8707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788619973.545299:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545315:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545321:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545327:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.545332:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545342:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545380:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.545384:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788619973.545389:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545397:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545549:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbef7e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac26 expref: 62 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545562:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:2.0:1788619973.545565:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788619973.545569:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbef7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac26 expref: 62 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.545581:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7a00, rc 0) 00000100:00100000:2.0:1788619973.546373:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657085952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2462us (3075us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788619973.546387:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:3.0:1788619973.551539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.551667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657086080 00000100:00100000:1.0:1788619973.551684:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657086080 00000100:00100000:1.0:1788619973.551765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1788619973.551814:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657086080:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788619973.551876:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788619973.552062:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657086080:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 250us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.552070:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1788619973.559310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.564296:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657086336 00000100:00100000:0.0:1788619973.564317:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657086336 00000100:00100000:2.0:1788619973.564752:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1788619973.564795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657086336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.564826:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.564831:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788619973.564868:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbef23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac0a expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.564917:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:2.0:1788619973.564924:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619973.564954:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbef93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac2d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788619973.565520:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788619973.566527:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.566552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.566567:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.566733:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbef93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac2d expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.566757:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac2d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.566767:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9333838fa400) 00010000:00010000:2.0:1788619973.566807:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619973.566813:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7c00, rc 0) 00000100:00100000:2.0:1788619973.566909:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+62:11651:x1875503657086336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2142us (7615us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788619973.568520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1788619973.573691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.574040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657086592 00000100:00100000:1.0:1788619973.574054:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657086592 00000100:00100000:1.0:1788619973.574139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1788619973.574151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+62:11651:x1875503657086592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788619973.574231:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619973.574316:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7c00/0xbb0e330328bbef9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac2d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.574337:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9333838fa400) 00010000:00010000:1.0:1788619973.574352:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619973.574381:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.574396:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.574408:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577154:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577177:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577190:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577401:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577409:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577416:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577423:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.577428:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577436:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577450:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619973.577453:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619973.577457:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577463:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143800/0xbb0e330328bbefa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577476:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577483:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577488:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577501:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.577504:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577510:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577517:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1b76a262 (ffff933390117300) 00010000:00010000:1.0:1788619973.577519:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619973.577521:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.577526:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbefaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b76a262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.579406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657086592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 5247us (5772us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788619973.579419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:3.0:1788619973.581981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.582390:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657086720 00000100:00100000:1.0:1788619973.582461:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657086720 00000100:00100000:1.0:1788619973.582541:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1788619973.582552:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+61:11651:x1875503657086720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619973.582580:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619973.582611:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbefb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac34 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.582676:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.582709:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.582723:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.582890:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbefb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 63 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.583326:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 62 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.583544:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:1.0:1788619973.583547:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788619973.583552:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142600, rc 0) 00000100:00100000:1.0:1788619973.583853:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+62:11651:x1875503657086720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1300us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.583864:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1788619973.589540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.590288:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657086976 00000100:00100000:2.0:1788619973.590305:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657086976 00000100:00100000:2.0:1788619973.590387:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1788619973.590505:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+62:11651:x1875503657086976:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.590743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.590765:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.590857:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788619973.591356:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1788619973.592201:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000997ee587 reply state 00000000c8a75bce transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.592216:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619973.592608:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+64:11651:x1875503657086976:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 2204us (3075us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788619973.593358:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00010000:00010000:3.0:1788619973.596235:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596269:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596282:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596290:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619973.596296:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596305:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596330:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:3.0:1788619973.596334:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788619973.596341:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.596349:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.600670:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.601321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657087104 00000100:00100000:2.0:1788619973.601336:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657087104 00000100:00100000:2.0:1788619973.601470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788619973.601483:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+63:11651:x1875503657087104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.601513:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.601542:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac3b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.601907:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.601930:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.601964:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:2.0:1788619973.601968:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788619973.601973:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6e00, rc 0) 00000100:00100000:2.0:1788619973.602069:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+64:11651:x1875503657087104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 587us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.602077:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1788619973.608846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.609114:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657087232 00000100:00100000:0.0:1788619973.609128:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657087232 00000100:00100000:0.0:1788619973.609736:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788619973.609753:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+9:2354:x1875503657087232:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788619973.610370:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+10:2354:x1875503657087232:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 619us (1535us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788619973.610380:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788619973.613464:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.613705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657087488 00000100:00100000:0.0:1788619973.613719:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657087488 00000100:00100000:0.0:1788619973.613889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788619973.613902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+64:11651:x1875503657087488:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788619973.615224:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+65:11651:x1875503657087488:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1312us (1761us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788619973.615238:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788619973.618868:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.619240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657087744 00000100:00100000:1.0:1788619973.619256:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657087744 00000100:00100000:1.0:1788619973.619339:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1788619973.619356:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+65:11651:x1875503657087744:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788619973.619549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+65:11651:x1875503657087744:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 199us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.619557:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1788619973.624939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.625070:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657087872 00000100:00100000:2.0:1788619973.625084:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657087872 00000100:00100000:2.0:1788619973.625180:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1788619973.625193:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+65:11651:x1875503657087872:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.625219:0:8707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619973.625260:0:8707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6a00/0xbb0e330328bbefd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac42 expref: -99 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625355:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625372:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625386:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619973.625582:0:8707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619973.625608:0:8707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625731:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6a00/0xbb0e330328bbefd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac42 expref: 67 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625754:0:8707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac42 expref: 66 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.625764:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:2.0:1788619973.625767:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788619973.625957:0:8707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7600, rc 0) 00000100:00100000:2.0:1788619973.626049:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+66:11651:x1875503657087872:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 857us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.626059:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:3.0:1788619973.629512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.629591:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088000 00000100:00100000:1.0:1788619973.629603:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088000 00000100:00100000:1.0:1788619973.634830:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1788619973.634851:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+10:2355:x1875503657088000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788619973.634883:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619973.634916:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac49 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788619973.634952:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2cc6, blocks: 0x1 00010000:00010000:1.0:1788619973.634981:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788619973.634987:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619973.635000:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.635023:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.635706:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143a00, rc 0) 00000100:00100000:1.0:1788619973.635933:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+11:2355:x1875503657088000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1085us (6433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.636330:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788619973.642999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.643816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088256 00000100:00100000:1.0:1788619973.643833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088256 00000100:00100000:1.0:1788619973.643910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1788619973.643920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+66:11651:x1875503657088256:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788619973.644761:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+66:11651:x1875503657088256:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 836us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.644808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:3.0:1788619973.648480:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.648580:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088384 00000100:00100000:0.0:1788619973.648593:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088384 00000100:00100000:0.0:1788619973.648666:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788619973.648678:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+11:11651:x1875503657088384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788619973.648702:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788619973.648726:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac50 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.648766:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.648820:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619973.648826:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619973.648832:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.648910:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.648927:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.648943:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1875503676996352:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619973.649060:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788619973.652880:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1875503676996352:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.652932:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.652963:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788619973.653046:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+12:11651:x1875503657088384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4369us (4580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.653056:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788619973.655404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.657882:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088512 00000100:00100000:1.0:1788619973.657905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088512 00010000:00010000:1.0:1788619973.657974:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.658028:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788619973.658040:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+12:2354:x1875503657088512:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619973.658061:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619973.658091:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.658118:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.658149:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbefe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac49 expref: 12 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.658171:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619973.658176:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619973.658186:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.658223:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.658275:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.658292:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875503676996480:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788619973.658413:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.674030:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875503676996480:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788619973.674057:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619973.674146:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f76a03-c7c3-4513-8603-309aac0577a7+11:2354:x1875503657088512:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 16107us (18756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.674157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1788619973.677806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.677906:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088640 00000100:00100000:0.0:1788619973.677925:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088640 00002000:00100000:0.0:1788619973.678009:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9333bd244a80 x1875503657088640/t0(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:69/0 lens 504/0 e 0 to 0 dl 1788619984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788619973.678022:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd244a80 with x1875503657088640 ext(0->12) 00002000:00010000:0.0:1788619973.678029:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bd244a80 00000100:00100000:0.0:1788619973.678071:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788619973.678115:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+11:2355:x1875503657088640:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788619973.681834:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:2355:x1875503657088640:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 3719us (4055us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788619973.681850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:0.0:1788619973.681866:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9333bd244a80 x1875503657088640/t4294967320(0) o4->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:69/0 lens 504/448 e 0 to 0 dl 1788619984 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788619973.681877:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bd244a80 with x1875503657088640 ext(0->12) 00002000:00010000:0.0:1788619973.681884:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bd244a80 00000100:00100000:3.0:1788619973.686832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.687826:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088768 00000100:00100000:2.0:1788619973.687843:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088768 00000100:00100000:2.0:1788619973.687919:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:2.0:1788619973.687932:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+66:11651:x1875503657088768:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788619973.741764:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788619973.741819:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788619973.741834:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333bc0b6180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788619973.741839:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933392e2b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333bc0b6a80 00000020:00080000:1.0:1788619973.741843:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933392e2b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff933284f01400 00000100:00100000:3.0:1788619973.742072:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676996608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788619973.742154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788619973.742347:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788619973.742384:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933390c0c480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788619973.742388:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bc7bf000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933390c0ce40 00000020:00080000:1.0:1788619973.742391:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333bc7bfb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff933384ef6800 00000020:00080000:1.0:1788619973.742418:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788619973.742604:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788619973.742732:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619973.742742:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676996736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788619973.742798:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619973.742991:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676996608 00000100:00100000:1.0:1788619973.742999:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676996608 00000100:00100000:1.0:1788619973.743077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676996736 00000100:00100000:1.0:1788619973.743080:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676996736 00000100:00080000:3.0:1788619973.743148:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788619973.743371:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+20:11651:x1875503657088768:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 55439us (56602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.743380:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:0.0:1788619973.744252:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788619973.744267:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676996608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788619973.744293:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788619973.744326:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c2cc5, atime: 0x6a9c2cc5, ctime: 0x6a9c2cc5, blocks: 0x1 00010000:00010000:0.0:1788619973.744335:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.744351:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788619973.744355:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788619973.744361:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.744376:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.744385:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.744407:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.744424:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788619973.745066:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619973.745074:0:7635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.745084:0:7635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788619973.745089:0:7635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.745116:0:7635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.745134:0:7635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.745142:0:7635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbefee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.745165:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619973.745167:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619973.745176:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619973.745591:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676996608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1325us (3433us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788619973.745600:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788619973.745689:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788619973.745701:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503676996736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788619973.745722:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788619973.745739:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.745755:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.745762:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788619973.745766:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788619973.745796:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.745830:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.745846:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 12 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.745870:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875503676996864:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619973.745998:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b69c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788619973.746130:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bc455500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788619973.746137:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676996608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788619973.748073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.749178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.749823:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657088896 00000100:00100000:0.0:1788619973.749833:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657088896 00000100:00100000:0.0:1788619973.749881:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788619973.749891:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:2354:x1875503657088896:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788619973.749980:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875503676996864:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.750007:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.750765:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089024 00000100:00100000:1.0:1788619973.751014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089024 00010000:00010000:1.0:1788619973.751046:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 14 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.751128:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788619973.751137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+14:2354:x1875503657089024:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619973.751151:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619973.751157:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 14 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.751171:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 14 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.751193:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b52154/0xbb0e330328bbedb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06abaf expref: 14 pid: 6691 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.751209:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788619973.751213:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788619973.751219:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.751244:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.751279:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619973.751332:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f76a03-c7c3-4513-8603-309aac0577a7+13:2354:x1875503657089024:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 196us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.751341:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:1.0:1788619973.757666:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.757686:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.757699:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.757708:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.757735:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788619973.758268:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503676996736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12567us (15465us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788619973.758279:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788619973.758336:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bc456d80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788619973.758349:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503676996736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788619973.758668:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619973.758676:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.758686:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788619973.758691:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.758701:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.758720:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.758728:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72263f2/0xbb0e330328bbeff5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.758747:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619973.758748:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619973.758750:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788619973.782924:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1788619973.782950:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1788619973.783076:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657088896:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 33181us (35006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.783087:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788619973.785909:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.786437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089280 00000100:00100000:2.0:1788619973.786448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089280 00000100:00100000:2.0:1788619973.786512:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:2.0:1788619973.786521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+20:11651:x1875503657089280:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.786572:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619973.786599:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7600/0xbb0e330328bbefd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac42 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.786617:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:2.0:1788619973.786623:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788619973.786727:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.786739:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.786748:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788619973.786988:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049656925 reply state 00000000157b2768 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.786997:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788619973.787087:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:11651:x1875503657089280:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 566us (1185us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788619973.787107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:1.0:1788619973.790571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.790649:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089408 00000100:00100000:2.0:1788619973.790659:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089408 00000100:00100000:2.0:1788619973.790719:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788619973.790729:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2357:x1875503657089408:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788619973.790971:0:8933:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788619973.790975:0:8933:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788619974 00002000:00010000:2.0:1788619973.790978:0:8933:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788619973 00002000:00010000:2.0:1788619973.790979:0:8933:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788619974 -> 1788619974 00002000:00010000:2.0:1788619973.790981:0:8933:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788619973.791046:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2357:x1875503657089408:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 319us (486us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788619973.791054:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00010000:00010000:3.0:1788619973.791998:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792011:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792019:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792026:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619973.792031:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792038:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792117:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:3.0:1788619973.792121:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788619973.792127:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.792134:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7a00/0xbb0e330328bbeffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.793394:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.793464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089664 00000100:00100000:0.0:1788619973.793473:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089664 00000100:00100000:0.0:1788619973.793523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:0.0:1788619973.793532:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:11651:x1875503657089664:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788619973.793594:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.793610:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.793619:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.793662:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 20 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.793696:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 20 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.793711:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676996992:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788619973.793810:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788619973.795964:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875503676996992:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.795995:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.797878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.797996:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089792 00000100:00100000:0.0:1788619973.798005:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089792 00010000:00010000:0.0:1788619973.798042:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 21 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.798081:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788619973.798090:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:2354:x1875503657089792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619973.798114:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619973.798121:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 21 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798134:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 21 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798154:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbefbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac34 expref: 21 pid: 8707 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798187:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:0.0:1788619973.798192:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798200:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798208:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.798239:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619973.798302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+20:2354:x1875503657089792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 212us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.798309:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00010000:00010000:2.0:1788619973.798899:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798909:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798936:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798944:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798950:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798955:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.798960:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798967:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.798993:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:2.0:1788619973.798996:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788619973.799001:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.799007:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2200/0xbb0e330328bbf003 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.799074:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:11651:x1875503657089664:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 5542us (5685us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788619973.799083:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1788619973.802589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.802686:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657089920 00000100:00100000:1.0:1788619973.802696:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657089920 00000100:00100000:1.0:1788619973.802767:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788619973.802812:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657089920:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788619973.802858:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.802879:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.802889:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788619973.802893:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788619973.802897:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.802933:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.802947:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 8 pid: 6689 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.802962:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875503676997120:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619973.803041:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.806161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.806261:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875503676997120:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788619973.806287:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.806352:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657090048 00000100:00100000:3.0:1788619973.806363:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657090048 00010000:00010000:3.0:1788619973.806399:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 9 pid: 6689 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.806441:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1788619973.806450:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+9:2355:x1875503657090048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.806478:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.806499:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 9 pid: 6689 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.806511:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 9 pid: 6689 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.806531:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbefe7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac50 expref: 9 pid: 6689 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.806544:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619973.806548:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788619973.806553:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.806562:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.806591:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619973.806648:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2355:x1875503657090048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 199us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.806656:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00010000:00010000:0.0:1788619973.806849:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806859:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806883:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806902:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806910:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806917:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619973.806922:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806932:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806944:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.806952:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf00a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.807004:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657089920:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 4195us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.807012:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788619973.810599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619973.810710:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657090304 00000100:00100000:2.0:1788619973.810720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657090304 00000100:00100000:2.0:1788619973.810805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1788619973.810817:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+19:11651:x1875503657090304:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788619973.810893:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.810909:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.810921:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.811147:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.811159:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.811175:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.811206:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.811219:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 20 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.811232:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc6de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676997248:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788619973.811319:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788619973.814060:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc6de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676997248:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788619973.814087:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.816420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.816552:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657090432 00000100:00100000:0.0:1788619973.816561:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657090432 00010000:00010000:0.0:1788619973.816600:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 21 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619973.816657:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788619973.816666:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387307450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:2355:x1875503657090432:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619973.816680:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619973.816688:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 21 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816701:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 21 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816722:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbefcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac3b expref: 21 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816739:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:0.0:1788619973.816744:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816752:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816759:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.816804:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619973.816856:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387307450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+20:2355:x1875503657090432:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 191us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.816863:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00010000:00010000:1.0:1788619973.817489:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.817497:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788619973.817688:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788619973.817875:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788619973.817920:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788619973.817999:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676997376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619973.818053:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619973.818091:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1788619973.818272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676997376 00000100:00100000:2.0:1788619973.818279:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676997376 00000100:00100000:2.0:1788619973.818322:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788619973.818331:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676997376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788619973.818403:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676997376:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619973.818410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788619973.818538:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788619973.818543:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788619973.818563:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9333bc456d80 x1875503676996736/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788619989 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788619973.818574:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676997376:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788619973.819158:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788619973.819216:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676997504:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788619973.819314:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619973.819339:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788619973.819394:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676997504 00000100:00100000:2.0:1788619973.819399:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676997504 00000100:00100000:2.0:1788619973.819434:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788619973.819441:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875503676997504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788619973.819600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875503676997504:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (285us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788619973.819606:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788619973.819820:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875503676997504:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788619973.819850:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819860:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819879:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819885:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.819889:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819897:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819912:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933390117100) 00010000:00010000:1.0:1788619973.819915:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788619973.819920:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819927:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7e00/0xbb0e330328bbf018 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819955:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819961:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819965:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819970:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.819973:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819988:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.819998:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:1.0:1788619973.820000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788619973.820007:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.820019:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.820027:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.820054:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.820066:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676997632:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788619973.820132:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.827220:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.827351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657090560 00000100:00100000:0.0:1788619973.827374:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657090560 00000100:00100000:0.0:1788619973.827433:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788619973.827443:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:11650:x1875503657090560:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:0.0:1788619973.827609:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+24:11650:x1875503657090560:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619973.827617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788619973.827803:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875503676997632:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788619973.827833:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827844:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7400/0xbb0e330328bbef5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827877:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827890:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827902:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827912:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827918:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827924:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827930:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.827933:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827951:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827963:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.827966:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788619973.827970:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827976:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6c00/0xbb0e330328bbf01f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827986:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827992:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.827998:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.828002:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619973.828005:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.828010:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.828018:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619973.828020:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788619973.828022:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619973.828038:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf011 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.828230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+23:11651:x1875503657090304:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 17414us (17639us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788619973.828239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000020:00080000:2.0:1788619973.828243:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788619973.828414:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619973.828419:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619973.828963:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788619973.828972:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619973.835038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.835082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619973.835119:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091072 00000100:00100000:0.0:1788619973.835128:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091072 00000100:00100000:0.0:1788619973.835176:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788619973.835186:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+23:11651:x1875503657091072:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788619973.835745:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657090816 00000100:00100000:1.0:1788619973.835750:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657090816 00000100:00100000:1.0:1788619973.835804:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:1.0:1788619973.835812:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+25:11650:x1875503657090816:12345-192.168.203.12@tcp:58:lfs.0 00000004:00080000:0.0:1788619973.836262:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788619973.836323:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788619973.836373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836389:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836400:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836408:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836414:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836419:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836442:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788619973.836527:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:11651:x1875503657091072:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1342us (1443us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788619973.836535:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:0.0:1788619973.836540:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788619973.836582:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619973.836588:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836596:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788619973.836600:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836609:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.836620:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788619973.836623:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000040:00080000:1.0:1788619973.836899:0:8707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788619973.836940:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+25:11650:x1875503657090816:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 1128us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.836948:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00010000:00010000:0.0:1788619973.839605:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.840336:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf026 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619973.840372:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619973.840374:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619973.840377:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619973.868869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619973.869090:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091200 00000100:00100000:1.0:1788619973.869109:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091200 00000100:00100000:1.0:1788619973.869159:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:1.0:1788619973.869168:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+25:11653:x1875503657091200:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788619973.869190:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788619973.869208:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf02d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869277:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869302:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869316:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869322:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869328:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869566:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869579:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869587:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869618:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.869632:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 26 pid: 5841 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788619973.869645:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676997760:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788619973.871195:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619973.873088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.873135:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875503676997760:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788619973.873164:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619973.873253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091456 00000100:00100000:2.0:1788619973.873261:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091456 00000100:00100000:2.0:1788619973.873315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788619973.873324:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+27:5595:x1875503657091456:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788619973.873549:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+28:5595:x1875503657091456:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 225us (469us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788619973.873557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788619973.879686:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619973.879831:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091584 00000100:00100000:3.0:1788619973.879841:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091584 00010000:00010000:3.0:1788619973.879883:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 28 pid: 5841 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.879935:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1788619973.879945:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:2354:x1875503657091584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788619973.879959:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619973.879966:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 28 pid: 5841 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.879978:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 28 pid: 5841 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.880000:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3c00/0xbb0e330328bbef4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac18 expref: 28 pid: 5841 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.880028:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619973.880034:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.880044:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.880052:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619973.880086:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788619973.880131:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880141:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619973.880166:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f76a03-c7c3-4513-8603-309aac0577a7+27:2354:x1875503657091584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 221us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619973.880175:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000004:00200000:1.0:1788619973.880181:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788619973.880186:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788619973.880204:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880228:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880238:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880244:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880259:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880264:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.880268:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880276:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:1.0:1788619973.880289:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619973.880294:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880301:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbf034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880312:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880317:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880329:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880335:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788619973.880338:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880345:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880353:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933390117100) 00010000:00010000:1.0:1788619973.880355:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788619973.880358:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880364:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf02d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac57 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880412:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac57 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619973.880419:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:1.0:1788619973.880421:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788619973.880424:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143600, rc 0) 00000100:00100000:1.0:1788619973.880451:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333909d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+26:11653:x1875503657091200:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 11285us (11594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619973.880470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00010000:00010000:0.0:1788619974.087174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788619974.528335:0:12626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619974.528345:0:12626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619974.528411:0:12626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788619974.528418:0:12626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788619974.855077:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619974.855086:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619974.855137:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788619974.855144:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788619974.855278:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676997888:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788619974.855388:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788619974.861417:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875503676997888:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788619974.863966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619974.864100:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091712 00000100:00100000:1.0:1788619974.864110:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091712 00000100:00080000:3.0:1788619974.864222:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619974.864236:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:1.0:1788619974.864249:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:11665:x1875503657091712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788619974.864296:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788619974.864402:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+26:11665:x1875503657091712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 156us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619974.864410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:0.0:1788619974.874267:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619974.874706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657091968 00000100:00100000:2.0:1788619974.874717:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657091968 00000100:00100000:2.0:1788619974.874800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:2.0:1788619974.874810:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+26:11665:x1875503657091968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788619974.874829:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619974.874849:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf049 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.874956:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbf050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.874970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbf050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.874980:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbf050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619974.874991:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788619974.875124:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf049 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac5e expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.875142:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbf050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac5e expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.875151:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619974.875154:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788619974.875158:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6200, rc 0) 00000100:00100000:2.0:1788619974.876803:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f76a03-c7c3-4513-8603-309aac0577a7+28:11665:x1875503657091968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1984us (2536us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788619974.876814:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:3.0:1788619974.881889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619974.881979:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619974.882293:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092224 00000100:00100000:2.0:1788619974.882304:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092224 00000100:00100000:2.0:1788619974.882363:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1788619974.882373:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:11665:x1875503657092224:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788619974.882455:0:8707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882488:0:8707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882503:0:8707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882682:0:8707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882690:0:8707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882699:0:8707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.882705:0:8707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788619974.882709:0:8707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788619974.883530:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092352 00000100:00100000:0.0:1788619974.883539:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092352 00000100:00100000:0.0:1788619974.883596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788619974.883604:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+30:2354:x1875503657092352:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788619974.883616:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619974.883635:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6200/0xbb0e330328bbf050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac5e expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619974.883655:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619974.883660:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619974.883719:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f76a03-c7c3-4513-8603-309aac0577a7+29:2354:x1875503657092352:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 115us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619974.883726:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00010000:2.0:1788619974.884336:0:8707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.884347:0:8707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:2.0:1788619974.884350:0:8707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788619974.884354:0:8707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619974.884360:0:8707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7800/0xbb0e330328bbf05e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788619974.884538:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+28:11665:x1875503657092224:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 2165us (2658us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788619974.884557:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000040:00080000:1.0:1788619974.884877:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619974.884882:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619974.885648:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788619974.885660:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788619974.891103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619974.891601:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092608 00000100:00100000:2.0:1788619974.891612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092608 00000100:00100000:2.0:1788619974.892587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788619974.892599:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+28:11665:x1875503657092608:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788619974.893015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+29:11665:x1875503657092608:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 417us (1931us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788619974.893024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:3.0:1788619975.110958:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619975.589870:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619975.589919:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619975.589952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619975.589978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619975.590060:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092864 00000100:00100000:1.0:1788619975.590071:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092864 00000100:00100000:1.0:1788619975.590142:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092992 00000100:00100000:1.0:1788619975.590146:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092992 00000100:00100000:1.0:1788619975.590169:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788619975.590179:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657092864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619975.590261:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657092864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619975.590269:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788619975.590287:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788619975.590294:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657092992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619975.590319:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2354:x1875503657092992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619975.590325:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788619975.590353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093120 00000100:00100000:1.0:1788619975.590356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093120 00000100:00100000:1.0:1788619975.590383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:1.0:1788619975.590389:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657093120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619975.590415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:2354:x1875503657093120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619975.590432:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:0.0:1788619975.590650:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657092736 00000100:00100000:0.0:1788619975.590655:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657092736 00000100:00100000:0.0:1788619975.590693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:0.0:1788619975.590700:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657092736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619975.590732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2354:x1875503657092736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619975.590737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00080000:3.0:1788619975.591104:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788619975.591109:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788619975.591112:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619975.879034:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676998272:0@lo:400:kworker.0 00000100:00100000:3.0:1788619975.879126:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619975.879240:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676998144:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.879277:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619975.879307:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788619975.879313:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676998016:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.879339:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619975.879375:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998272 00000100:00100000:1.0:1788619975.879381:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998272 00000100:00100000:1.0:1788619975.879427:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998144 00000100:00100000:1.0:1788619975.879431:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998144 00000100:00100000:1.0:1788619975.879449:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788619975.879481:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676998272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.879610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788619975.879743:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676998144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.879881:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503676998144:12345-0@lo:400:kworker.0 Request processed in 69us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619975.879890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788619975.879924:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619975.879954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998016 00000100:00100000:2.0:1788619975.879959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998016 00000100:00100000:2.0:1788619975.879986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788619975.879993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676998016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.880030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503676998016:12345-0@lo:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619975.880036:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788619975.880078:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998400:0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.880118:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619975.880159:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998400 00000100:00100000:2.0:1788619975.880163:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998400 00000100:00100000:2.0:1788619975.880206:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788619975.880213:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.880245:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998400:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619975.880252:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788619975.880265:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788619975.880291:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998400:0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.880920:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503676998016:0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.880934:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503676998144:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.884692:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503676998272:12345-0@lo:400:kworker.0 Request processed in 5200us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619975.884716:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788619975.888691:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503676998272:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.890012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788619975.890753:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676998656:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.890841:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619975.890889:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676998528:0@lo:400:kworker.0 00000100:00100000:1.0:1788619975.890913:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619975.891166:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998528 00000100:00100000:3.0:1788619975.891175:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998528 00000100:00100000:3.0:1788619975.891243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788619975.891252:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676998528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788619975.891304:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503676998528:12345-0@lo:400:kworker.0 Request processed in 53us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619975.891310:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1788619975.891657:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619975.891691:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503676998528:0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.894045:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998656 00000100:00100000:2.0:1788619975.894058:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998656 00000100:00100000:2.0:1788619975.894138:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788619975.894148:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676998656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619975.894241:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676998656:12345-0@lo:400:kworker.0 Request processed in 94us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619975.894248:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788619975.894292:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676998656:0@lo:400:kworker.0 00000100:00080000:1.0:1788619975.894362:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788619976.135755:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619976.391946:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1788619976.391988:0:8001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379360215056ns, next at 380360212617ns, rc = 0 00000100:00100000:1.0:1788619976.394655:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619976.394726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619976.397645:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998784 00000100:00100000:0.0:1788619976.397659:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998784 00000100:00100000:0.0:1788619976.397762:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788619976.397799:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788619976.397840:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619976.397928:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619976.397936:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788619976.398042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998784:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788619976.411541:0:12678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619976.411550:0:12678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619976.411612:0:12678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788619976.411618:0:12678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788619976.576701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619976.577308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093376 00000100:00100000:3.0:1788619976.577624:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093376 00000100:00100000:3.0:1788619976.577728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:3.0:1788619976.577740:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+29:11685:x1875503657093376:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788619976.578166:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788619976.578485:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbf065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.578587:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf06c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.578601:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf06c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.578613:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf06c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788619976.578624:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:0.0:1788619976.579296:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788619976.579932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1800/0xbb0e330328bbf065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac65 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.579957:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf06c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac65 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.579965:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619976.579968:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788619976.579972:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0a00, rc 0) 00000100:00100000:3.0:1788619976.580084:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+31:11685:x1875503657093376:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2337us (3381us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788619976.580110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:3.0:1788619976.590962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619976.590998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093504 00000100:00100000:3.0:1788619976.591007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093504 00000100:00100000:3.0:1788619976.591062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:3.0:1788619976.591072:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:11685:x1875503657093504:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788619976.591154:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.591171:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.591184:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.591213:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.591220:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.592379:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.592393:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788619976.592399:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.592407:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.592433:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:3.0:1788619976.592436:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788619976.592442:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619976.592449:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbf07a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788619976.592546:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+31:11685:x1875503657093504:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 1473us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619976.592555:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:1.0:1788619976.688185:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619976.688365:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093632 00000100:00100000:2.0:1788619976.688376:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093632 00000100:00100000:2.0:1788619976.688481:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1788619976.688491:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657093632:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788619976.688523:0:8933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619976.688544:0:8933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf081 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac6c expref: -99 pid: 8933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788619976.688571:0:8933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c2cc6, atime: 0x6a9c2cc5, ctime: 0x6a9c2cc6, blocks: 0xb 00010000:00010000:2.0:1788619976.688589:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1788619976.688594:0:8933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788619976.688605:0:8933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf081 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac6c expref: 8 pid: 8933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619976.688622:0:8933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf081 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac6c expref: 8 pid: 8933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619976.688635:0:8933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6000, rc 0) 00000100:00100000:2.0:1788619976.688696:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+8:2356:x1875503657093632:12345-192.168.203.12@tcp:101:cat.0 Request processed in 206us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619976.688703:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1788619976.694292:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619976.694410:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093760 00000100:00100000:2.0:1788619976.694421:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093760 00002000:00100000:2.0:1788619976.694465:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9333bc10d180 x1875503657093760/t0(0) o3->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:72/0 lens 488/0 e 0 to 0 dl 1788619987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788619976.694478:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc10d180 with x1875503657093760 ext(0->4095) 00002000:00010000:2.0:1788619976.694484:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc10d180 00000100:00100000:2.0:1788619976.694553:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788619976.694563:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2356:x1875503657093760:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:2.0:1788619976.694809:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f76a03-c7c3-4513-8603-309aac0577a7+8:2356:x1875503657093760:12345-192.168.203.12@tcp:3:cat.0 Request processed in 247us (584us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788619976.694817:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:2.0:1788619976.694824:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9333bc10d180 x1875503657093760/t0(0) o3->11f76a03-c7c3-4513-8603-309aac0577a7@192.168.203.12@tcp:72/0 lens 488/4536 e 0 to 0 dl 1788619987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788619976.694834:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc10d180 with x1875503657093760 ext(0->4095) 00002000:00010000:2.0:1788619976.694837:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9333bc10d180 00000100:00100000:2.0:1788619976.903185:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619976.903258:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619976.903698:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676998912 00000100:00100000:0.0:1788619976.903707:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676998912 00000100:00100000:0.0:1788619976.903768:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788619976.903796:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788619976.903831:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788619976.903889:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503676998912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619976.903895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788619976.903980:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676998912:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788619976.966045:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788619976.966064:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1788619977.159102:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619978.183123:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788619979.007450:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:1.0:1788619979.007479:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:1.0:1788619979.007500:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333bc4ed540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788619979.007506:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933386718c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333bc4ed600 00000020:00080000:1.0:1788619979.007509:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff933386718600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff933386707800 00000020:00080000:1.0:1788619979.007532:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788619979.007542:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1788619979.007575:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:3.0:1788619979.008319:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:1.0:1788619979.008320:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000100:00100000:3.0:1788619979.008342:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676999040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788619979.008410:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619979.008481:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999040 00000100:00100000:3.0:1788619979.008489:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999040 00000020:00080000:1.0:1788619979.008526:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788619979.008544:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788619979.008555:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875503676999040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788619979.008736:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788619979.008740:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788619974 -> 1788619974 00002000:00010000:3.0:1788619979.008743:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788619973 -> 1788619973 00002000:00010000:3.0:1788619979.008745:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788619974 -> 1788619974 00002000:00010000:3.0:1788619979.008748:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788619979.008809:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875503676999040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (398us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788619979.008826:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788619979.008848:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788619979.009392:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93328599b800/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788619979.009401:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503676999040:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788619979.027512:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788619979.027532:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788619979.027537:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00010000:00010000:1.0:1788619979.207703:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619980.231162:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619980.703342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619980.703388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619980.703423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619980.703451:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657093888 00000100:00100000:3.0:1788619980.703459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619980.703464:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657093888 00000100:00100000:3.0:1788619980.703491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619980.703516:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094400 00000100:00100000:3.0:1788619980.703521:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094400 00000100:00100000:1.0:1788619980.703526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:1.0:1788619980.703540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657093888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619980.703562:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094016 00000100:00100000:3.0:1788619980.703567:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094016 00000100:00100000:1.0:1788619980.703610:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2356:x1875503657093888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619980.703617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00080000:1.0:1788619980.703667:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619980.703687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788619980.703694:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657094400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619980.703724:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+5:2356:x1875503657094400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619980.703729:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1788619980.703811:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094144 00000100:00100000:2.0:1788619980.703816:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094144 00000100:00100000:2.0:1788619980.703854:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094272 00000100:00100000:2.0:1788619980.703858:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094272 00000100:00100000:2.0:1788619980.703881:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788619980.703887:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657094144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619980.703915:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+5:2356:x1875503657094144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619980.703921:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788619980.703935:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788619980.703941:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657094272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619980.703965:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2356:x1875503657094272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619980.703988:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1788619980.704082:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00080000:1.0:1788619980.704085:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788619980.704090:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788619980.704103:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:2356:x1875503657094016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788619980.704263:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:2356:x1875503657094016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 174us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619980.704270:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788619980.770401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619980.770494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094528 00000100:00100000:3.0:1788619980.770503:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094528 00000100:00100000:3.0:1788619980.770564:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1788619980.770573:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:11330:x1875503657094528:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788619980.770700:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:11330:x1875503657094528:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 127us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619980.770708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:0.0:1788619980.772557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619980.772645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094784 00000100:00100000:2.0:1788619980.772654:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094784 00000100:00100000:2.0:1788619980.772720:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788619980.772729:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:11330:x1875503657094784:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788619980.773424:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:11330:x1875503657094784:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 691us (870us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788619980.773442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788619981.000239:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676999552:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.000376:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788619981.000383:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676999168:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000413:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.000449:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676999680:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.000502:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999168 00000100:00100000:2.0:1788619981.000509:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999168 00000100:00100000:2.0:1788619981.000548:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788619981.000557:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676999168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000605:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+19:3309:x1875503676999168:12345-0@lo:400:kworker.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.000612:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788619981.000643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999680 00000100:00100000:2.0:1788619981.000647:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999680 00000100:00100000:2.0:1788619981.000685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788619981.000709:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676999680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000743:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503676999680:12345-0@lo:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.000748:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788619981.000766:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999552 00000100:00100000:2.0:1788619981.000793:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999552 00000100:00100000:2.0:1788619981.000823:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788619981.000829:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676999552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000858:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503676999552:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.000863:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788619981.000897:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503676999168:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000910:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503676999680:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.000918:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788619981.000923:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788619981.000944:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bc455500, transno 4294967310 00000100:00100000:2.0:1788619981.000960:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503676999552:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001005:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676999424:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.001063:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788619981.001069:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676999296:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001091:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.001109:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676999808:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619981.001167:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999808 00000100:00100000:2.0:1788619981.001171:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999808 00000100:00100000:2.0:1788619981.001196:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788619981.001203:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676999808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001234:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676999808:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.001239:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788619981.001253:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999424 00000100:00100000:2.0:1788619981.001256:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999424 00000100:00100000:2.0:1788619981.001275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999296 00000100:00100000:2.0:1788619981.001278:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999296 00000100:00100000:2.0:1788619981.001290:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788619981.001295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676999424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001323:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503676999424:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.001328:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788619981.001339:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788619981.001344:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676999296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001368:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503676999296:12345-0@lo:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.001373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788619981.001413:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503676999296:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001421:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788619981.001424:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333bc456d80, transno 4294967321 00000004:00080000:2.0:1788619981.001432:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788619981.001448:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93328599b800 x1875503676999040/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788619995 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788619981.001469:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676999808:0@lo:400:kworker.0 00000100:00100000:2.0:1788619981.001488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503676999424:0@lo:400:kworker.0 00000100:00080000:1.0:1788619981.003114:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788619981.003123:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788619981.063251:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788619981.063261:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788619981.063545:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788619981.063552:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788619981.077291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619981.077381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657094912 00000100:00100000:2.0:1788619981.077391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657094912 00000100:00100000:2.0:1788619981.077461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:2.0:1788619981.077473:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+5:12138:x1875503657094912:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:2.0:1788619981.077494:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788619981.077517:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077589:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077604:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077617:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788619981.077660:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788619981.077664:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788619981.077687:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077731:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed7000/0xbb0e330328bbf088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac73 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077749:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac73 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619981.077757:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:2.0:1788619981.077760:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788619981.077763:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6e00, rc 0) 00000100:00100000:2.0:1788619981.077873:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b894fa53-facf-4302-9d74-955690a8c92e+6:12138:x1875503657094912:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 402us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619981.077880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00010000:00010000:0.0:1788619981.255010:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619981.514659:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676999936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619981.514728:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619981.514891:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503676999936 00000100:00100000:1.0:1788619981.514901:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503676999936 00000100:00100000:1.0:1788619981.514969:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788619981.514991:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676999936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788619981.515025:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788619981.515110:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788619981.518052:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875503676999936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3041us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619981.518066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788619981.519000:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503676999936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788619982.024262:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788619982.024285:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677000064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788619982.024353:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619982.024463:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000064 00000100:00100000:3.0:1788619982.024486:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000064 00000100:00100000:3.0:1788619982.024549:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788619982.024560:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677000064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619982.024592:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619982.024641:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677000064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619982.024648:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788619982.024702:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677000064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788619982.025093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788619982.281463:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619983.303007:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788619984.164092:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788619984.164127:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788619984.164148:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788619984.164161:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788619984.174526:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:02000400:2.0:1788619984.278486:0:12881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:53:03 (1788619983) 00010000:00010000:0.0:1788619984.337392:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619985.351076:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619985.822361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619985.822412:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619985.822461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619985.822486:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619985.822517:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619985.822530:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095168 00000100:00100000:1.0:1788619985.822543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095040 00000100:00100000:2.0:1788619985.822544:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095168 00000100:00100000:1.0:1788619985.822546:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095040 00000100:00100000:2.0:1788619985.822595:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095552 00000100:00100000:2.0:1788619985.822598:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095552 00000100:00100000:1.0:1788619985.822601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 302 00000100:00100000:1.0:1788619985.822611:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657095040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619985.822617:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1788619985.822624:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:2355:x1875503657095168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619985.822702:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f76a03-c7c3-4513-8603-309aac0577a7+18:2355:x1875503657095168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619985.822713:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095424 00000100:00100000:0.0:1788619985.822718:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095424 00000100:00100000:2.0:1788619985.822726:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1788619985.822745:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:0.0:1788619985.822751:0:8933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095296 00000100:00100000:2.0:1788619985.822752:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+6:2355:x1875503657095552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788619985.822753:0:8933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095296 00000100:00100000:0.0:1788619985.822810:0:8933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1788619985.822818:0:8933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657095424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788619985.826175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2355:x1875503657095040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3546us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619985.826195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 302 00000100:00100000:2.0:1788619985.831880:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b894fa53-facf-4302-9d74-955690a8c92e+6:2355:x1875503657095552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 9107us (9341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619985.831900:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1788619985.831967:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:2.0:1788619985.831985:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657095296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788619985.832065:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+5:2355:x1875503657095296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (9577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619985.832073:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00080000:2.0:1788619985.832100:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788619985.832106:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619985.832111:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788619985.843643:0:8933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f76a03-c7c3-4513-8603-309aac0577a7+7:2355:x1875503657095424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20805us (21209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619985.843664:0:8933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788619986.119286:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677000448:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619986.119465:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788619986.119473:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677000320:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619986.119518:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677000832:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119547:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619986.119590:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000448 00000100:00100000:2.0:1788619986.119598:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000448 00000100:00100000:2.0:1788619986.119660:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000320 00000100:00100000:2.0:1788619986.119686:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000320 00000100:00100000:2.0:1788619986.119717:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788619986.119728:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677000448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119824:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677000448:12345-0@lo:400:kworker.0 Request processed in 98us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619986.119833:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788619986.119866:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788619986.119874:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677000320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119899:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677000320:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619986.119905:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788619986.119924:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000832 00000100:00100000:2.0:1788619986.119928:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000832 00000100:00100000:2.0:1788619986.119959:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788619986.119965:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677000832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.119995:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677000832:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619986.120001:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788619986.120028:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788619986.120033:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788619986.120076:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677000320:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.120086:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788619986.120092:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93328599b800, transno 4294967324 00000100:00100000:2.0:1788619986.120103:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677000832:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.120112:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677000448:0@lo:400:kworker.0 00000100:00100000:3.0:1788619986.120558:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677000192:0@lo:400:kworker.0 00000100:00100000:3.0:1788619986.120605:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619986.120635:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677000704:0@lo:400:kworker.0 00000100:00100000:1.0:1788619986.120668:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677000576:0@lo:400:kworker.0 00000100:00100000:3.0:1788619986.120675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619986.120717:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619986.120718:0:8707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000704 00000100:00100000:3.0:1788619986.120724:0:8707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000704 00000100:00100000:3.0:1788619986.120798:0:8707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788619986.120806:0:8707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677000704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.121028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000192 00000100:00100000:2.0:1788619986.121045:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000192 00000100:00100000:2.0:1788619986.121075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788619986.121082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503677000192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.121120:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503677000192:12345-0@lo:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619986.121126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788619986.121188:0:8707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677000704:12345-0@lo:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619986.121196:0:8707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1788619986.125170:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619986.125224:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000576 00000100:00100000:1.0:1788619986.125237:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000576 00000100:00100000:2.0:1788619986.125259:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677000192:0@lo:400:kworker.0 00000100:00100000:2.0:1788619986.125284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677000704:0@lo:400:kworker.0 00000100:00100000:1.0:1788619986.125317:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788619986.125339:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677000576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619986.125802:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677000576:12345-0@lo:400:kworker.0 Request processed in 464us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619986.126036:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788619986.126078:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788619986.126110:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677000576:0@lo:400:kworker.0 00010000:00010000:1.0:1788619986.375382:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619986.634862:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bcb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677000960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788619986.634969:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619986.635403:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677000960 00000100:00100000:3.0:1788619986.635415:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677000960 00000100:00100000:3.0:1788619986.635489:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788619986.635500:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677000960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788619986.635551:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619986.636289:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677000960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 787us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619986.636321:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788619986.636425:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677000960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788619987.143809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788619987.143839:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677001088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619987.143921:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619987.144090:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001088 00000100:00100000:3.0:1788619987.144106:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001088 00000100:00100000:3.0:1788619987.144187:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788619987.144200:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677001088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788619987.144251:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619987.144345:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677001088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619987.144353:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788619987.144450:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677001088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788619987.399158:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619988.278268:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619988.278677:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657095808 00000100:00100000:2.0:1788619988.278691:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657095808 00000100:00100000:2.0:1788619988.278830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788619988.278854:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+18:12359:x1875503657095808:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788619988.279338:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:12359:x1875503657095808:12345-192.168.203.12@tcp:35:umount.0 Request processed in 486us (1087us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788619988.279349:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:1.0:1788619988.279457:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788619988.295218:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619988.295443:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657096064 00000100:00100000:2.0:1788619988.295467:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657096064 00000100:00100000:2.0:1788619988.295537:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788619988.295549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+19:12359:x1875503657096064:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788619988.296032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:12359:x1875503657096064:12345-192.168.203.12@tcp:35:umount.0 Request processed in 482us (829us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788619988.296062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:0.0:1788619988.302983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619988.303093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657096320 00000100:00100000:2.0:1788619988.303114:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657096320 00000100:00100000:2.0:1788619988.303198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788619988.303211:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333858df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+20:12359:x1875503657096320:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788619988.303900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333858df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f76a03-c7c3-4513-8603-309aac0577a7+21:12359:x1875503657096320:12345-192.168.203.12@tcp:35:umount.0 Request processed in 684us (921us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788619988.303913:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788619988.328405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619988.328682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657096576 00000100:00100000:3.0:1788619988.328692:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657096576 00000100:00100000:3.0:1788619988.328751:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788619988.328762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+21:12359:x1875503657096576:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:3.0:1788619988.329334:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f76a03-c7c3-4513-8603-309aac0577a7+22:12359:x1875503657096576:12345-192.168.203.12@tcp:35:umount.0 Request processed in 571us (934us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788619988.329343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788619988.341990:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619988.342042:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788619988.342078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619988.342150:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657097088 00000100:00100000:1.0:1788619988.342168:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657097088 00000100:00100000:1.0:1788619988.342276:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1788619988.342290:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+7:2353:x1875503657097088:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:1.0:1788619988.342339:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe647 00000100:00100000:2.0:1788619988.342347:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657096960 00000020:00010000:1.0:1788619988.342352:0:6689:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333836dc000: total 0 00000100:00100000:2.0:1788619988.342360:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657096960 00000100:00080000:1.0:1788619988.342360:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9333836d9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788619988.342418:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788619988.342421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657097216 00000100:00100000:2.0:1788619988.342427:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657097216 00000100:00100000:2.0:1788619988.342458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619988.342472:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+14:2357:x1875503657096960:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619988.342489:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619988.342522:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031600/0xbb0e330328bbe107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7fe expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619988.342548:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619988.342607:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+13:2357:x1875503657096960:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 140us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619988.342617:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788619988.342646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788619988.342654:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:2357:x1875503657097216:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619988.342664:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619988.343065:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6eb800/0xbb0e330328bbe06d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a7c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619988.343076:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788619988.343317:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1788619988.343356:0:7634:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333836dc000: total 0 00010000:00010000:0.0:1788619988.343398:0:7634:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333836dc000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788619988.343470:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf081 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac6c expref: 5 pid: 8933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.343515:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051fa963e/0xbb0e330328bbe9e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa9e expref: 4 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.343531:0:7634:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333836dc000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788619988.343542:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619988.343559:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619988.343560:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619988.345131:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f76a03-c7c3-4513-8603-309aac0577a7+2:2353:x1875503657097088:12345-192.168.203.12@tcp:9:umount.0 Request processed in 2830us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619988.345148:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788619988.346377:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2357:x1875503657097216:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 3711us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619988.346391:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788619988.346957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619988.347405:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657097344 00000100:00100000:1.0:1788619988.347415:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657097344 00000100:00100000:1.0:1788619988.347478:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788619988.347488:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2354:x1875503657097344:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788619988.347644:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788619988.347664:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813ce400/0xbb0e330328bbe2f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c9 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619988.347693:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788619988.347745:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657097344:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 259us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619988.348333:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788619988.352142:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788619988.352265:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657097472 00000100:00100000:1.0:1788619988.352276:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657097472 00000100:00100000:1.0:1788619988.352350:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1788619988.352361:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+5:2353:x1875503657097472:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:1.0:1788619988.352391:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe3df 00000100:00080000:1.0:1788619988.352400:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9333a53c7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788619988.352444:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788619988.352722:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f76a03-c7c3-4513-8603-309aac0577a7+2:2353:x1875503657097472:12345-192.168.203.12@tcp:9:umount.0 Request processed in 363us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619988.352730:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:3.0:1788619988.352925:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788619988.353627:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788619988.364420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619988.364950:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657098496 00000100:00100000:2.0:1788619988.364961:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657098496 00000100:00100000:2.0:1788619988.365027:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1788619988.365038:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+22:2353:x1875503657098496:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:2.0:1788619988.365070:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe07b 00000020:00010000:2.0:1788619988.365086:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333a53c5800: total 0 00000100:00080000:2.0:1788619988.365091:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9333a53c6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788619988.365122:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788619988.365483:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f76a03-c7c3-4513-8603-309aac0577a7+21:2353:x1875503657098496:12345-192.168.203.12@tcp:39:umount.0 Request processed in 446us (1071us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788619988.365492:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00000020:00010000:0.0:1788619988.365898:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333a53c5800: total 0 00010000:00010000:0.0:1788619988.365940:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333a53c5800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788619988.365974:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619988.365977:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619988.365985:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142200/0xbb0e330328bbe9a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa89 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366013:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619988.366015:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788619988.366020:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eaa00/0xbb0e330328bbe9ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa97 expref: 19 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366033:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619988.366035:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788619988.366039:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143600/0xbb0e330328bbf042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac57 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366050:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619988.366053:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788619988.366056:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf06c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac65 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366070:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619988.366073:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619988.366091:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6ea000/0xbb0e330328bbe6a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a9c5 expref: 16 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366106:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933388291c00) 00010000:00010000:0.0:1788619988.366109:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619988.366113:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cf600/0xbb0e330328bbe345 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8d7 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366132:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619988.366134:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788619988.366137:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338a6eac00/0xbb0e330328bbed40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ab93 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366160:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933388291100) 00010000:00010000:0.0:1788619988.366162:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619988.366167:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143200/0xbb0e330328bbef62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac1f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366181:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff933388291200) 00010000:00010000:0.0:1788619988.366183:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788619988.366186:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbea61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aac1 expref: 12 pid: 8707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366200:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff933390117f00) 00010000:00010000:0.0:1788619988.366203:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788619988.366207:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3200/0xbb0e330328bbe8c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aa51 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366219:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933390117800) 00010000:00010000:0.0:1788619988.366229:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788619988.366234:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbe3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8f3 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366253:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788619988.366256:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788619988.366259:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbea45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aaba expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366271:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933390117700) 00010000:00010000:0.0:1788619988.366273:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788619988.366277:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ee00/0xbb0e330328bbe361 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8de expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619988.366289:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333a53c5800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788619988.366301:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619988.366303:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619988.366305:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788619988.423012:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788619989.240759:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000001:00080000:1.0:1788619989.240804:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788619989.240817:0:5864:0:(genops.c:885:class_export_put()) final put ffff9333a53c5800/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:0.0:1788619989.241567:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c5800/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-MDT0000 00000020:00000080:0.0:1788619989.241628:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333a53c6800 for lustre-MDT0000 00000001:00100000:3.0:1788619989.246009:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:3.0:1788619989.246018:0:7647:0:(genops.c:885:class_export_put()) final put ffff9333836dc000/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:3.0:1788619989.246057:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333836dc000/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-OST0001 00000020:00000080:3.0:1788619989.246104:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333836d9800 for lustre-OST0001 00010000:00010000:0.0:1788619989.449722:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619989.993099:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619989.993153:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788619989.993212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619989.993437:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657098624 00000100:00100000:2.0:1788619989.993447:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657098624 00000100:00100000:2.0:1788619989.993499:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657098880 00000100:00100000:2.0:1788619989.993503:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657098880 00000100:00100000:2.0:1788619989.993514:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657098752 00000100:00100000:2.0:1788619989.993516:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657098752 00000100:00100000:2.0:1788619989.993532:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788619989.993541:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+12:2354:x1875503657098624:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619989.993557:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619989.993577:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b30a00/0xbb0e330328bbe14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a813 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619989.993602:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619989.993649:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+11:2354:x1875503657098624:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 109us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619989.993658:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788619989.993674:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788619989.993680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387304850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+10:2354:x1875503657098880:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619989.993688:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619989.993696:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cf800/0xbb0e330328bbe2ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a8c2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619989.993719:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619989.993738:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387304850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+9:2354:x1875503657098880:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619989.993745:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788619989.993821:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788619989.993827:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+8:2354:x1875503657098752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788619989.993840:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788619989.993849:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18ea00/0xbb0e330328bbe154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a83d expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619989.993857:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788619989.993872:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+7:2354:x1875503657098752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619989.993878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788619989.998117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619989.998934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099136 00000100:00100000:2.0:1788619989.998965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099136 00000100:00100000:2.0:1788619989.999063:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:2.0:1788619989.999075:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+6:2353:x1875503657099136:12345-192.168.203.12@tcp:39:umount.0 00000100:00080000:1.0:1788619989.999085:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788619989.999119:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe162 00000020:00010000:2.0:1788619989.999128:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333bd2c4800: total 0 00000100:00080000:2.0:1788619989.999133:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9333bd2c1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788619989.999158:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788619989.999246:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333bd2c4800: total 0 00010000:00010000:3.0:1788619989.999324:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333bd2c4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788619989.999378:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788619989.999384:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788619989.999397:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c1ed6e00/0xbb0e330328bbf08f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac73 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619989.999439:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333bd2c4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788619989.999455:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619989.999458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619989.999464:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788619989.999650:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b894fa53-facf-4302-9d74-955690a8c92e+3:2353:x1875503657099136:12345-192.168.203.12@tcp:39:umount.0 Request processed in 575us (1545us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788619989.999661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:0.0:1788619990.026331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788619990.026442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099392 00000100:00100000:2.0:1788619990.026455:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099392 00000100:00100000:2.0:1788619990.026538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 304 00000100:00100000:2.0:1788619990.026550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+7:2353:x1875503657099392:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:2.0:1788619990.026613:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe058 00000020:00010000:2.0:1788619990.026623:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff933387166000: total 0 00000100:00080000:2.0:1788619990.026629:0:5833:0:(import.c:65:import_set_state_nolock()) ffff933387163800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788619990.026725:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1dd753e7-5c3e-4f40-a5f5-57e3c38c975d+3:2353:x1875503657099392:12345-192.168.203.12@tcp:251:umount.0 Request processed in 175us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619990.026734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 304 00000020:00010000:0.0:1788619990.026979:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff933387166000: total 0 00010000:00010000:0.0:1788619990.026992:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619990.027052:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933387166000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788619990.027103:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18e400/0xbb0e330328bbe10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06a805 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619990.027123:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933387166000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788619990.027159:0:5829:0:(genops.c:885:class_export_put()) final put ffff933387166000/1dd753e7-5c3e-4f40-a5f5-57e3c38c975d 00010000:00010000:0.0:1788619990.027174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619990.027176:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619990.027177:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788619990.030379:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933387166000/1dd753e7-5c3e-4f40-a5f5-57e3c38c975d for MGS 00000020:00000080:1.0:1788619990.030457:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933387163800 for MGS 00010000:00010000:0.0:1788619990.471303:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619991.246734:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677001216:0@lo:400:kworker.0 00000100:00100000:0.0:1788619991.247030:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619991.247090:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677001728:0@lo:400:kworker.0 00000100:00100000:2.0:1788619991.247241:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677001344:0@lo:400:kworker.0 00000100:00100000:0.0:1788619991.247574:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619991.247618:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619991.247625:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677001600:0@lo:400:kworker.0 00000100:00100000:0.0:1788619991.247656:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619991.247687:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677001472:0@lo:400:kworker.0 00000100:00100000:0.0:1788619991.247711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619991.247747:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001600 00000100:00100000:0.0:1788619991.247756:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001600 00000100:00100000:0.0:1788619991.247843:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788619991.247854:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677001600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788619991.247917:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677001600:12345-0@lo:400:kworker.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619991.247924:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788619991.247984:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677001600:0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001216 00000100:00100000:1.0:1788619991.248143:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001216 00000100:00100000:1.0:1788619991.248185:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788619991.248193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503677001216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503677001216:12345-0@lo:400:kworker.0 Request processed in 44us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619991.248253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788619991.248286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001728 00000100:00100000:1.0:1788619991.248291:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001728 00000100:00100000:1.0:1788619991.248321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001472 00000100:00100000:1.0:1788619991.248324:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001472 00000100:00100000:1.0:1788619991.248348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788619991.248354:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677001728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248387:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677001728:12345-0@lo:400:kworker.0 Request processed in 34us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619991.248394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788619991.248406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788619991.248412:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677001472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248445:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677001472:12345-0@lo:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619991.248450:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1788619991.248467:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788619991.248472:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788619991.248500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677001472:0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248535:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677001216:0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.248546:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677001728:0@lo:400:kworker.0 00000100:00100000:2.0:1788619991.249219:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619991.249261:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677001856:0@lo:400:kworker.0 00000100:00100000:2.0:1788619991.249297:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619991.249327:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001856 00000100:00100000:2.0:1788619991.249331:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001856 00000100:00100000:2.0:1788619991.249367:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788619991.249380:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677001856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619991.249417:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677001856:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619991.249423:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788619991.249439:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788619991.249457:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677001856:0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.249653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001344 00000100:00100000:1.0:1788619991.249658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001344 00000100:00100000:1.0:1788619991.249690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788619991.249696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677001344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788619991.249731:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677001344:12345-0@lo:400:kworker.0 Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788619991.249743:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788619991.249768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677001344:0@lo:400:kworker.0 00000040:00080000:1.0:1788619991.306462:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788619991.306473:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788619991.307012:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788619991.307020:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788619991.495433:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619991.754016:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677001984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788619991.754112:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619991.754223:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677001984 00000100:00100000:3.0:1788619991.754233:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677001984 00000100:00100000:3.0:1788619991.754293:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788619991.754303:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677001984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788619991.754351:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788619991.754402:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677001984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619991.754410:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788619991.754488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677001984:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1788619992.177710:0:13079:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788619992.192174:0:13079:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788619992.192225:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619992.192240:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619992.192248:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619992.192257:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788619992.192284:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788619992.192290:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788619992.192315:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788619992.192320:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788619992.192327:0:13079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788619992.192351:0:13079:0:(import.c:65:import_set_state_nolock()) ffff9333bf42f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788619992.192468:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619992.192475:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192493:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ebc00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788619992.192496:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192504:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788619992.192512:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619992.192518:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788619992.192520:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788619992.192523:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788619992.192549:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192556:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788619992.192585:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192593:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ebc00/0xbb0e330328bbe0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192607:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.192609:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.192611:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619992.192618:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619992.192636:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788619992.192700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619992.192799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002240 00000100:00100000:0.0:1788619992.192807:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002240 00000100:00100000:0.0:1788619992.192871:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788619992.192880:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+19:3310:x1875503677002240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788619992.192895:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619992.192910:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18e000/0xbb0e330328bbe0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0dd expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.192922:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619992.192960:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+18:3310:x1875503677002240:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619992.192967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788619992.193015:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788619992.193836:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677002112:0@lo:39:umount.0 00000100:00100000:1.0:1788619992.193879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619992.193950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002112 00000100:00100000:3.0:1788619992.193957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002112 00000100:00100000:3.0:1788619992.194010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788619992.194018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875503677002112:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788619992.194053:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde67 00000100:00080000:3.0:1788619992.194062:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9333bb9e5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788619992.194122:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1875503677002112:12345-0@lo:39:umount.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619992.194129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788619992.194139:0:5840:0:(genops.c:885:class_export_put()) final put ffff9333bb9e6000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788619992.194160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788619992.194169:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bb9e6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788619992.194210:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bb9e5000 for lustre-MDT0000 00000100:00080000:3.0:1788619992.194237:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bf42f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788619992.194247:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677002112:0@lo:39:umount.0 00000100:00080000:2.0:1788619992.197176:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788619992.197184:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788619992.197189:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788619992.198494:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198510:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198517:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198524:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198546:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788619992.198552:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198558:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198565:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198584:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198699:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788619992.198708:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198715:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198722:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619992.198728:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198762:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788619992.198783:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198791:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6ea800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619992.198795:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198803:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619992.198810:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619992.198815:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788619992.198818:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788619992.198848:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198862:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619992.198893:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198900:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6ea800/0xbb0e330328bbe0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198913:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788619992.198916:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198921:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619992.198924:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198931:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619992.198937:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619992.198942:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788619992.198944:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788619992.198946:0:7634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788619992.198959:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.198965:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619992.198989:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199007:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b30400/0xbb0e330328bbe012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199021:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788619992.199025:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199030:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788619992.199033:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199040:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788619992.199046:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619992.199051:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788619992.199053:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788619992.199075:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199080:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788619992.199086:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199093:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619992.199094:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788619992.199097:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788619992.199120:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677002496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619992.199179:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619992.199219:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788619992.199224:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677002624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619992.199242:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619992.199266:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619992.199284:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619992.199309:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002496 00000100:00100000:3.0:1788619992.199314:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002496 00000100:00100000:3.0:1788619992.199350:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002624 00000100:00100000:3.0:1788619992.199353:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002624 00000100:00100000:3.0:1788619992.199365:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002368 00000100:00100000:3.0:1788619992.199367:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002368 00000100:00100000:3.0:1788619992.199381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788619992.199388:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+20:3311:x1875503677002496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788619992.199400:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619992.199411:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031a00/0xbb0e330328bbe019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe012 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199425:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619992.199456:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+19:3311:x1875503677002496:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619992.199462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788619992.199477:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788619992.199483:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+18:3311:x1875503677002624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788619992.199489:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619992.199497:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18ec00/0xbb0e330328bbe31b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe314 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199512:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619992.199535:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+17:3311:x1875503677002624:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619992.199540:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788619992.199552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788619992.199558:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+16:3310:x1875503677002368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788619992.199565:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788619992.199573:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b31000/0xbb0e330328bbe0f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0eb expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.199582:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788619992.199608:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503677002368:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788619992.199614:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788619992.199645:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677002624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619992.199653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677002496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788619992.199675:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788619992.201997:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619992.202704:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788619992.202714:0:13079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18f400/0xbb0e330328bbe314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe31b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788619992.202731:0:13079:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788619992.202949:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.202958:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.202964:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788619992.203027:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.203609:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788619992.203619:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.203627:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788619992.203630:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.203637:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788619992.203644:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788619992.203649:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788619992.203659:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788619992.204305:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.204315:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788619992.204345:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.204356:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.204357:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.204359:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788619992.204369:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788619992.204387:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788619992.204450:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788619992.204502:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002752 00000100:00100000:0.0:1788619992.204508:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002752 00000100:00100000:0.0:1788619992.204554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788619992.204564:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+15:3310:x1875503677002752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788619992.204576:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788619992.204592:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b31a00/0xbb0e330328bbddcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbddc6 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788619992.204610:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788619992.204644:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42040134-1c22-4778-8507-c9e1e3983208+14:3310:x1875503677002752:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619992.204651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788619992.204694:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677002752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788619992.205806:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788619992.205816:0:13079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333813cec00/0xbb0e330328bbddc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbddcd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788619992.205833:0:13079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788619992.205840:0:13079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788619992.205842:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788619992.205872:0:13079:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788619992.205877:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788619992.205882:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788619992.205887:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788619992.205892:0:13079:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff933284eaa800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788619992.205897:0:13079:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9333bbd76800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788619992.205904:0:13079:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9333bd2c4800 b894fa53-facf-4302-9d74-955690a8c92e 192.168.203.12@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788619992.205908:0:13079:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff933387134d40) has exports, disconnecting them 00000020:00080000:3.0:1788619992.205912:0:13079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff933284eaa800), last request at 1788619991 00000020:00000080:3.0:1788619992.205918:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdfda 00000100:00080000:3.0:1788619992.205933:0:13079:0:(import.c:65:import_set_state_nolock()) ffff933284ea9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788619992.205997:0:13079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff933284eaa800): rc 0 00000020:00000080:3.0:1788619992.205999:0:13079:0:(genops.c:885:class_export_put()) final put ffff933284eaa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788619992.206009:0:13079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9333bbd76800), last request at 1788619991 00000020:00000080:3.0:1788619992.206012:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdf01 00000100:00080000:3.0:1788619992.206017:0:13079:0:(import.c:65:import_set_state_nolock()) ffff9333bbd77800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788619992.206031:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933284eaa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1788619992.207166:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788619992.207194:0:13079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333bbd76800): rc 0 00000020:00000080:2.0:1788619992.207198:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bbd76800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788619992.207207:0:13079:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc7c0106fae0 00000100:00080000:2.0:1788619992.207227:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788619992.207231:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788619992.207243:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788619992.207309:0:13079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788619992.207329:0:13079:0:(import.c:65:import_set_state_nolock()) ffff933284da3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788619992.207343:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788619992.207346:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788619992.207353:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788619992.207408:0:13079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788619992.207416:0:13079:0:(import.c:65:import_set_state_nolock()) ffff9333a53c4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788619992.207450:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff933387134d40) has no exports 00000100:00100000:2.0:1788619992.207506:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788619992.207524:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bcbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1875503677003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788619992.207553:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677002880:0@lo:9:umount.0 00000100:00100000:2.0:1788619992.207611:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619992.207635:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677003008:0@lo:9:umount.0 00000100:00100000:2.0:1788619992.207653:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788619992.207758:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284ea9000 for lustre-MDT0000 00000020:00000080:3.0:1788619992.207764:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd76800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788619992.207812:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbd77800 for lustre-MDT0000 00000100:00100000:0.0:1788619992.208558:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677002880 00000100:00100000:0.0:1788619992.208567:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677002880 00000100:00100000:0.0:1788619992.208632:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003008 00000100:00100000:0.0:1788619992.208636:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003008 00000100:00100000:0.0:1788619992.208660:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788619992.208667:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcbe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875503677002880:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788619992.208704:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdf5c 00000100:00080000:0.0:1788619992.208712:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9333bbf2d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788619992.208742:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788619992.208946:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcbe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3308:x1875503677002880:12345-0@lo:9:umount.0 Request processed in 278us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619992.208953:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788619992.208979:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788619992.208987:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875503677003008:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788619992.208999:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe043 00000100:00080000:0.0:1788619992.209005:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9332849a3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788619992.209023:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788619992.210884:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3308:x1875503677003008:12345-0@lo:9:umount.0 Request processed in 1892us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788619992.210895:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788619992.210933:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.210939:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788619992.210984:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284da3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788619992.211002:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788619992.211004:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788619992.211008:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677002880:0@lo:9:umount.0 00000100:00080000:0.0:1788619992.211020:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788619992.211029:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788619992.211031:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788619992.211033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677003008:0@lo:9:umount.0 00010000:00010000:0.0:1788619992.211762:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619992.211814:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788619992.219381:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff933387134d40) has no exports 00000020:00000080:2.0:1788619992.286733:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde21 00000020:00000080:2.0:1788619992.286747:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bd357000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788619992.286762:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788619992.286845:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd357000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788619992.286891:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788619992.286900:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788619992.286904:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff933387458000) has no exports 00000020:00000080:2.0:1788619992.287178:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde1a 00000020:00000080:2.0:1788619992.287185:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bf425800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788619992.287196:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bf425800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788619992.287236:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619992.287242:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788619992.287246:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bf423800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788619992.287248:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bf423800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788619992.287263:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:0.0:1788619992.304762:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788619992.304791:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333bbf2a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788619992.304812:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:0.0:1788619992.304815:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333a53c4000/11f76a03-c7c3-4513-8603-309aac0577a7 00000020:00000080:2.0:1788619992.305401:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbf2a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788619992.305445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c4000/11f76a03-c7c3-4513-8603-309aac0577a7 for lustre-OST0000 00000020:00000080:2.0:1788619992.305467:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbf2d800 for lustre-OST0000 00000020:00000080:2.0:1788619992.305471:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333a53c7000 for lustre-OST0000 00010000:00010000:0.0:1788619992.519457:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619993.544247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788619994.353411:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b894fa53-facf-4302-9d74-955690a8c92e 00000001:00080000:2.0:1788619994.353426:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788619994.353431:0:5864:0:(genops.c:885:class_export_put()) final put ffff9333bd2c4800/b894fa53-facf-4302-9d74-955690a8c92e 00000020:00000080:2.0:1788619994.353455:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd2c4800/b894fa53-facf-4302-9d74-955690a8c92e for lustre-MDT0000 00000020:00000080:2.0:1788619994.355117:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bd2c1000 for lustre-MDT0000 00000001:00100000:0.0:1788619994.378396:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788619994.378406:0:7647:0:(genops.c:885:class_export_put()) final put ffff9332849a3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788619994.378495:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788619994.378542:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9332849a3800 for lustre-OST0001 00010000:00010000:0.0:1788619994.567131:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619995.591809:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788619996.361059:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677003392:0@lo:400:kworker.0 00000100:00100000:1.0:1788619996.361157:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619996.361243:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788619996.361250:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503677003264:0@lo:400:kworker.0 00000100:00100000:1.0:1788619996.361281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619996.361543:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003392 00000100:00100000:3.0:1788619996.361553:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003392 00000100:00100000:3.0:1788619996.361603:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788619996.361611:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1875503677003392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788619996.361626:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788619996.361671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1875503677003392:12345-0@lo:400:kworker.0 Request processed in 59us (513us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788619996.361678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788619996.361896:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788619996.361955:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788619996.361999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003264 00000100:00100000:2.0:1788619996.362004:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003264 00000100:00100000:2.0:1788619996.362038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788619996.362046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:3312:x1875503677003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788619996.362290:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42040134-1c22-4778-8507-c9e1e3983208+14:3312:x1875503677003264:12345-0@lo:400:kworker.0 Request processed in 244us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788619996.362297:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788619996.362792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003520 00000100:00100000:3.0:1788619996.362800:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003520 00000100:00100000:3.0:1788619996.362839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788619996.362846:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875503677003520:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788619996.362853:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788619996.362907:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875503677003520:12345-0@lo:400:kworker.0 Request processed in 51us (942us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788619996.362913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788619996.363581:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42040134-1c22-4778-8507-c9e1e3983208:3312:1875503677003264:0@lo:400:kworker.0 00000100:00080000:1.0:1788619996.363598:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788619996.363604:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788619996.363608:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788619996.372097:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788619996.372107:0:3309:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788619996.372112:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788619996.372125:0:3309:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788619996.372130:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:2.0:1788619996.372145:0:3309:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933284eb7000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788619996.372187:0:3309:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bc456d80 x1875503677003648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788619996.372245:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677003520:0@lo:400:kworker.0 00000100:00100000:0.0:1788619996.372311:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677003648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788619996.372383:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788619996.372661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003648 00000100:00100000:3.0:1788619996.372669:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003648 00000100:00100000:3.0:1788619996.372719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788619996.372726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875503677003648:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788619996.372745:0:5841:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788619996.383723:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788619996.383734:0:3312:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 185 00000100:00080000:1.0:1788619996.383743:0:3312:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333c1e01000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788619996.384583:0:3312:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933285999c00 x1875503677003776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788619996.384661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677003776:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788619996.384729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788619996.386012:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677003392:0@lo:400:kworker.0 00000100:00100000:1.0:1788619996.386082:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677003776 00000100:00100000:1.0:1788619996.386090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677003776 00000100:00100000:1.0:1788619996.386128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788619996.386135:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677003776:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788619996.386151:0:5840:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788619996.391856:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677003776:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5710us (7117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788619996.391871:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788619996.393438:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788619996.393450:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788619996.393455:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677003776:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788619996.400108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875503677003648:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 27373us (27717us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788619996.400140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788619996.400266:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788619996.400272:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788619996.400276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677003648:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788619996.615626:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788619997.639005:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788619998.342954:0:13079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333ad1bf660 - data ffff9333b380e6c0/ffff9333bcdbe000 00000020:01000000:2.0:1788619998.343286:0:13079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333acea7900 - data ffff93339f394438/ffff9333880f4c00 00000001:00000004:2.0:1788619998.349282:0:13079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788619998.445861:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788619998.445870:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788619998.445897:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788619998.445900:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788619998.448315:0:6716:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788619998.448323:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788619998.448361:0:6716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788619998.449672:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788619998.449679:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788619998.449697:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788619998.449699:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788619998.450082:0:8000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788619998.450087:0:8000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788619998.450095:0:8000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788619998.531227:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdde9 00000020:00000080:2.0:1788619998.531240:0:13079:0:(genops.c:885:class_export_put()) final put ffff933387164000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788619998.531589:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933387164000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788619998.536895:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbddfe 00000020:00000080:2.0:1788619998.536910:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bd352000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788619998.536936:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788619998.536942:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788619998.536960:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788619998.536965:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff933387133380) has no exports 00000020:00000080:3.0:1788619998.537263:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd352000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788619998.537304:0:13079:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788619998.537314:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe03c 00000020:00000080:2.0:1788619998.537319:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333b949f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788619998.537340:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788619998.537344:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788619998.537351:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788619998.537354:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9333bd344d40) has no exports 00000020:00000080:2.0:1788619998.537359:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbe035 00000020:00000080:2.0:1788619998.537363:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333a53c2800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788619998.538995:0:13079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788619998.539002:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788619998.539006:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788619998.539014:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788619998.539016:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788619998.539053:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619998.539064:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788619998.539070:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdf39 00000020:00000080:2.0:1788619998.539078:0:13079:0:(genops.c:885:class_export_put()) final put ffff933284df5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788619998.539087:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788619998.539091:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788619998.539095:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788619998.539098:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9333a53acd40) has no exports 00000020:00000080:2.0:1788619998.539103:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdf2b 00000020:00000080:2.0:1788619998.539106:0:13079:0:(genops.c:885:class_export_put()) final put ffff933284da7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788619998.539236:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333b949f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788619998.539248:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788619998.539255:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333a53c4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788619998.539261:0:496:0:(genops.c:885:class_export_put()) final put ffff9333bd350000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788619998.539263:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd350000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788619998.539268:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:2.0:1788619998.540265:0:13079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788619998.540270:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788619998.540274:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788619998.540279:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788619998.540281:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788619998.540978:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619998.541000:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788619998.541036:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619998.541039:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788619998.541044:0:13079:0:(genops.c:885:class_export_put()) final put ffff933387162000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788619998.541048:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff933387162000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788619998.541055:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788619998.541273:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde05 00000020:00000080:2.0:1788619998.541284:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bd355800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788619998.542236:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933284df5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788619998.542248:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933284da7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788619998.542256:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284da3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788619998.542275:0:496:0:(genops.c:885:class_export_put()) final put ffff933284da2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788619998.542278:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933284da2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788619998.542283:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788619998.544798:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788619998.545107:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788619998.545119:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788619998.545124:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9333bd340000) has no exports 00000020:00000080:3.0:1788619998.545151:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788619998.545157:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788619998.545164:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde0c 00000020:00000080:3.0:1788619998.545172:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333bd357800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788619998.545182:0:13079:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93338a7b5000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788619998.545185:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93338a7b5000 3 00000020:01000004:3.0:1788619998.545188:0:13079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93338a7b5000 from lustre-MDT0000 00000020:00000080:3.0:1788619998.545205:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788619998.545209:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788619998.545211:0:13079:0:(genops.c:885:class_export_put()) final put ffff933387165000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788619998.545223:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff933387165000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788619998.545231:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788619998.545291:0:13079:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788619998.545296:0:13079:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788619998.545299:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788619998.545302:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788619998.545306:0:13079:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788619998.545313:0:13079:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff933387e53000 42040134-1c22-4778-8507-c9e1e3983208 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788619998.545319:0:13079:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9333874599c0) has exports, disconnecting them 00000020:00000080:1.0:1788619998.545323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd355800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:3.0:1788619998.545325:0:13079:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff933387e53000), last request at 1788619765 00000020:00000080:3.0:1788619998.545341:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbddaa 00000020:00010000:3.0:1788619998.545345:0:13079:0:(genops.c:1921:obd_stale_export_put()) Put export ffff933387e53000: total 2 00000100:00080000:3.0:1788619998.545350:0:13079:0:(import.c:65:import_set_state_nolock()) ffff933387e53800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788619998.545362:0:13079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff933387e53000): rc 0 00000020:00080000:3.0:1788619998.545366:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9333874599c0) has no exports 00000100:00100000:3.0:1788619998.545425:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9333afef2400:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1788619998.545535:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9333afef3600:5835] 2 exiting: rc = 0 00000020:00000080:1.0:1788619998.546676:0:37:0:(genops.c:885:class_export_put()) final put ffff933387163000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788619998.546680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff933387163000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788619998.546694:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788619998.546907:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd357800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788619998.546990:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff933387e53000: total 0 00010000:00010000:2.0:1788619998.547025:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933387e53000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788619998.547055:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030c00/0xbb0e330328bbe0ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0a5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547072:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6ea200/0xbb0e330328bbe0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0b3 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547096:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380030e00/0xbb0e330328bbe0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0cf expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547107:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933380031e00/0xbb0e330328bbe0c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0c1 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547118:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbe2ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe2f8 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547128:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b30e00/0xbb0e330328bbdeb4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbdead expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547141:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338a6ea600/0xbb0e330328bbe100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe0f9 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547166:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c3800/0xbb0e330328bbe30d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbe306 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788619998.547177:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933387e53000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788619998.547191:0:5828:0:(genops.c:885:class_export_put()) final put ffff933387e53000/42040134-1c22-4778-8507-c9e1e3983208 00010000:00010000:2.0:1788619998.547209:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619998.547211:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788619998.547213:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788619998.547273:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff933387e53000/42040134-1c22-4778-8507-c9e1e3983208 for MGS 00000020:00000080:1.0:1788619998.547306:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933387e53800 for MGS 00000100:00100000:0.0:1788619998.547741:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9333afef3c00:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1788619998.547848:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547859:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547867:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547876:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547886:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547895:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547905:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547912:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547921:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547938:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547946:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547954:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547962:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547970:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547977:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.547995:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548002:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548010:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548018:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548025:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548033:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548040:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548049:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548056:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548065:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548072:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548080:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548087:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548094:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548104:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548113:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548118:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548124:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548130:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548135:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548140:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548145:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548150:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548155:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548161:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548166:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548171:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548179:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548191:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548211:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548217:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548229:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548236:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548241:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548246:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548259:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548264:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548269:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548275:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548280:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548285:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548291:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548296:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548302:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548307:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548313:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548318:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548324:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.548329:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788619998.548682:0:13079:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788619998.548686:0:13079:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788619998.551187:0:13079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933392576480 - data ffff93339c7e61b0/ffff933284815c00 00000020:01000000:3.0:1788619998.551340:0:13079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333a53fc300 - data ffff93339c427af8/ffff933390355400 00000020:00000080:3.0:1788619998.552316:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdd8e 00000020:00000080:3.0:1788619998.552324:0:13079:0:(genops.c:885:class_export_put()) final put ffff933390dff000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788619998.552346:0:13079:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93338a7b5000 from MGS, refs=2 00000020:01000004:3.0:1788619998.552350:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93338a7b5000 2 00000020:01000004:3.0:1788619998.552353:0:13079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93338a7b5000 from MGS 00000020:00000080:3.0:1788619998.552379:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788619998.552387:0:13079:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788619998.552390:0:13079:0:(genops.c:885:class_export_put()) final put ffff933390df8800/MGS 00000020:00000080:3.0:1788619998.552393:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff933390df8800/MGS for MGS 00000020:01000000:3.0:1788619998.552399:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788619998.552447:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788619998.552450:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788619998.552455:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788619998.552460:0:13079:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9333ace0d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788619998.552465:0:13079:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93338745b380) has exports, disconnecting them 00000020:00080000:3.0:1788619998.552478:0:13079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9333ace0d800), last request at 1788619766 00000020:00000080:3.0:1788619998.552482:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde59 00000020:00080000:3.0:1788619998.552492:0:13079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333ace0d800): rc 0 00000020:00000080:3.0:1788619998.552496:0:13079:0:(genops.c:885:class_export_put()) final put ffff9333ace0d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788619998.552898:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933390dff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788619998.552909:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333ace0d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788619998.556845:0:13079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788619998.556854:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788619998.556859:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788619998.556867:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788619998.557197:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619998.557206:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788619998.557281:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bf42f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788619998.557291:0:496:0:(genops.c:885:class_export_put()) final put ffff9333bf429000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788619998.557295:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bf429000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788619998.557301:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788619998.557465:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93338a7b5000 1 00000020:00000080:2.0:1788619998.557474:0:13079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdd80 00000020:00000080:2.0:1788619998.557482:0:13079:0:(genops.c:885:class_export_put()) final put ffff933390dfc000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788619998.557496:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788619998.557575:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788619998.557582:0:13079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788619998.557586:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9333a53ab380) has no exports 00000020:00000080:1.0:1788619998.557696:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933390dfc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788619998.664213:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788619998.676222:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788619998.676239:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788619998.676246:0:13079:0:(genops.c:885:class_export_put()) final put ffff93338f907800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788619998.676252:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff93338f907800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788619998.676264:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788619998.677057:0:13079:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933393165800 00000020:01000000:3.0:1788619998.677087:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788619998.677108:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788619998.677114:0:13079:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788619998.677119:0:13079:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff933387130000) has no exports 00000100:00100000:3.0:1788619998.677220:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9333874bcc00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788619998.677474:0:8707:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93338cd28800:8707] 3 exiting: rc = 0 00000100:00100000:0.0:1788619998.677672:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9333874bc000:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1788619998.677899:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff933383eb6c00:5842] 2 exiting: rc = 0 00000100:00100000:3.0:1788619998.678195:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678202:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678208:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678214:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678220:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678225:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678231:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678236:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678242:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678247:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678260:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678267:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678274:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678282:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678288:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678295:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678302:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678309:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678317:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678324:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678330:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678337:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678343:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678350:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678370:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678377:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678384:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678392:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678399:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678405:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678419:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678427:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678435:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678443:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678450:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678456:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678463:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678469:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678476:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678483:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678489:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678495:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678501:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678523:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678530:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678537:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678545:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678552:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678558:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678565:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678573:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678579:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678585:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678595:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678602:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678610:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678617:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678624:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678631:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678649:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678657:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678665:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678673:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.678680:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.685992:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff933383eb7600:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1788619998.692749:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff933383eb7c00:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1788619998.697086:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697099:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697106:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697114:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697122:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697129:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697138:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697163:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697174:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697184:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697191:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697203:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697211:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697216:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697222:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697227:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.697233:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699046:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699067:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699072:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699078:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699084:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699090:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699096:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699102:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699109:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699116:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699122:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699130:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699137:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699147:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699155:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699164:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699172:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699179:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699186:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699194:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699201:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699218:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699226:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699233:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699242:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699265:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699271:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699278:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699286:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699294:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699302:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699313:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699323:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699331:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699337:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699351:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699356:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699361:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699367:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699373:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699378:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.699384:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.701076:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.701109:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.701115:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.701124:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.701132:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.704201:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93338581aa00:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1788619998.704391:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93338581b200:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1788619998.704592:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704602:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704609:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704615:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704623:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704630:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704637:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704644:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704652:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704676:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704685:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704693:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704700:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704721:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704729:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704737:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704747:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704754:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704762:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704769:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704796:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704820:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704828:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704835:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704842:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704850:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704856:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704861:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704867:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704873:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704884:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704892:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704898:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704919:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704938:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704948:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704954:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704961:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704966:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704974:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704982:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704989:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.704996:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705003:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705011:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705040:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705048:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705053:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705066:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705072:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705078:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705097:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705106:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705117:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705124:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705135:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705143:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705162:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705168:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705173:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705179:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705190:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705198:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.705221:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788619998.730288:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93338581b000:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1788619998.730995:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93338581a200:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788619998.731317:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731324:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731329:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731349:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731354:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731359:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731364:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731369:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731374:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731379:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731384:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731389:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731395:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731401:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731406:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731412:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731419:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731424:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731431:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731437:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731442:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731447:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731451:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731456:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731461:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731466:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731472:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731477:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731482:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731488:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731493:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731497:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731502:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731506:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731511:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731516:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731521:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731526:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731539:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731544:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731549:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731553:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731558:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731563:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731567:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731572:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731576:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731581:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731586:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731591:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731596:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731600:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731605:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731610:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731614:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731619:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731624:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731629:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731634:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731639:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731644:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731649:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731654:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.731659:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.732898:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff933383eb1e00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1788619998.732991:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff933383eb0600:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1788619998.733508:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733515:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733520:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733525:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733532:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733539:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733546:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733552:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733558:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733669:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733675:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733680:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733685:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733690:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733695:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733701:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733708:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733715:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733722:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733728:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733733:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733738:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733743:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733748:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733753:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733758:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733763:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733870:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733880:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733885:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.733890:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734114:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734119:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734124:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734128:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734133:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734138:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734375:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734383:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734387:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734392:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734396:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734400:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734404:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734419:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734424:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734429:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734433:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734438:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734443:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734447:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734452:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734457:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734462:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734467:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734473:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734478:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734483:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734487:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734492:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734497:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734502:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734507:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.734513:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788619998.737016:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff933383eb1a00:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1788619998.737033:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff933383eb0c00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1788619998.737136:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737144:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737149:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737153:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737158:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737163:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737168:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737172:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737177:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737181:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737186:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737190:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737195:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737202:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737209:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737216:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737223:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737228:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737233:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737237:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737242:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737248:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737253:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737259:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737266:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737286:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737291:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737296:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737300:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737306:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737311:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737317:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737323:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737330:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737335:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737340:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737344:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737349:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737353:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737359:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737366:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737373:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737381:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737386:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737391:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737396:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737401:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737406:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737411:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737418:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737425:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737432:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737439:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737445:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737449:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737454:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737459:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737464:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737471:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.737478:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.740397:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.740412:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.740419:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788619998.740423:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741179:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff933383eb1000:5855] 2 exiting: rc = 0 00000100:00100000:1.0:1788619998.741311:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9333afef2200:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788619998.741445:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff933383eb1c00:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1788619998.741530:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741536:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741542:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741548:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741554:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741559:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741564:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741605:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741612:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741617:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741622:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741627:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741632:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741638:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741656:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741662:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741668:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741674:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741680:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741686:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741691:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741697:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741702:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741708:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741713:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741718:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741724:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741734:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741740:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741745:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741751:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741804:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741812:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741819:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741826:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741831:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741837:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741842:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741848:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741854:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741859:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741866:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741874:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741884:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741889:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741895:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741900:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741906:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741911:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741931:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741937:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741943:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741949:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741954:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741960:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741979:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741986:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741991:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.741997:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.742002:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.742008:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.742013:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.742019:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788619998.742024:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788619998.748327:0:13079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788619998.748338:0:13079:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788619998.748344:0:13079:0:(genops.c:885:class_export_put()) final put ffff933387129000/MDS_uuid 00000020:00000080:2.0:1788619998.748349:0:13079:0:(genops.c:844:class_export_destroy()) destroying export ffff933387129000/MDS_uuid for MDS 00000020:01000000:2.0:1788619998.748354:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788619998.748488:0:13079:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788619999.687649:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620000.711288:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788620001.478978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788620001.478993:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788620001.478997:0:37:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620001.479005:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 399 00000100:00080000:1.0:1788620001.479011:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788620001.479017:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333c1e01000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620001.479038:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93328599bb80 x1875503677004032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788620001.479052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788620001.479067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788620001.479069:0:37:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620001.479073:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:1.0:1788620001.479083:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788620001.479087:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933284eb7000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620001.479101:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933285998a80 x1875503677004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620001.479845:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677003904:0@lo:400:kworker.0 00000400:00000100:0.0:1788620001.479895:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875503677003904 offset 0 length 224: 4 00000100:00100000:2.0:1788620001.481353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677004032:0@lo:38:kworker.0 00000400:00000100:2.0:1788620001.481401:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677004032 offset 0 length 520: 4 00000100:00100000:2.0:1788620001.481425:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677004160:0@lo:38:kworker.0 00000400:00000100:2.0:1788620001.481441:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677004160 offset 0 length 520: 4 00000020:01000004:0.0:1788620001.660574:0:13233:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788620001.700008:0:13233:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788620001.700055:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.700081:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.700089:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.700097:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.700119:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788620001.700125:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788620001.700147:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620001.700157:0:13233:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93328599bb80 x1875503677004032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620001.700176:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788620001.700181:0:13233:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788620001.700186:0:13233:0:(import.c:65:import_set_state_nolock()) ffff9333c1e01000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788620001.700191:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620001.700194:0:13233:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93328599bb80 x1875503677004032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620001.700201:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788620001.700204:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788620001.700298:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677004032:0@lo:38:kworker.0 00010000:00010000:0.0:1788620001.701305:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701318:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701338:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701344:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701358:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620001.701364:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701370:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701376:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701382:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620001.701391:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788620001.701395:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788620001.701414:0:13233:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788620001.701419:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788620001.701423:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620001.701428:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620001.701432:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9332849c99c0) has no exports 00000020:00080000:0.0:1788620001.701455:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9332849c99c0) has no exports 00000020:01000000:0.0:1788620001.703063:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933392576e40 - data ffff93339f3e41b0/ffff933284817800 00000020:01000000:0.0:1788620001.703219:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333bcbea420 - data ffff93339f37c948/ffff933284939800 00010000:00010000:2.0:1788620001.703934:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788620001.703944:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.703955:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620001.703960:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.703977:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620001.703984:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620001.703990:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620001.703993:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788620001.703995:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788620001.704031:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704037:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620001.704062:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704069:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18e600/0xbb0e330328bbe0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704081:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620001.704084:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704090:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30c00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620001.704093:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704099:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620001.704115:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620001.704120:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620001.704122:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788620001.704124:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788620001.704138:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704143:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620001.704162:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704169:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b30c00/0xbb0e330328bbe0cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe0d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704179:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620001.704182:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704188:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620001.704190:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704197:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620001.704203:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620001.704218:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788620001.704220:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788620001.704222:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788620001.704235:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704241:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620001.704256:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704262:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbe306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbe30d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620001.704271:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620001.704273:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620001.704275:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620001.704281:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620001.704287:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620001.704303:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677004288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620001.704367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620001.704416:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620001.704423:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677004416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620001.704446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620001.704474:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503677004544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620001.704494:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620001.704530:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677004288 00000100:00100000:2.0:1788620001.704548:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677004288 00000100:00100000:2.0:1788620001.704583:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677004416 00000100:00100000:2.0:1788620001.704592:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677004416 00000100:00100000:2.0:1788620001.704605:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677004544 00000100:00100000:2.0:1788620001.704608:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677004544 00000100:00100000:2.0:1788620001.704621:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788620001.704627:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387304450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1875503677004288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788620001.704643:0:7636:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620001 with bad export cookie 13478766823427792298 00000100:00100000:1.0:1788620001.707167:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620001.707179:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875503677004416:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788620001.707186:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620001 with bad export cookie 13478766823427792298 00000100:00100000:1.0:1788620001.707275:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875503677004416:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (2827us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788620001.707282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620001.707304:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788620001.707309:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1875503677004544:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788620001.707313:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620001 with bad export cookie 13478766823427792298 00000100:00100000:1.0:1788620001.707356:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1875503677004544:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (2860us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788620001.707361:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788620001.707456:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788620001.707461:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93338712c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788620001.707465:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788620001.708323:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788620001.727158:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788620001.727163:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788620001.727174:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93328599a680 x1875503677003904/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788620017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620001.727204:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333c1ed8380 x1875503677004288/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620017 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620001.727213:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333c1eda300 x1875503677004416/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620017 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620001.727221:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333c1edaa00 x1875503677004544/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620017 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788620001.727228:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788620001.727231:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788620001.727233:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788620001.727561:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93338712c800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788620001.727588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677004288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620001.727613:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42040134-1c22-4778-8507-c9e1e3983208:3311:1875503677004416:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788620001.727710:0:3309:0:(import.c:65:import_set_state_nolock()) ffff93338712c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620001.727716:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:3.0:1788620001.727724:0:3309:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff93338712c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620001.727740:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42040134-1c22-4778-8507-c9e1e3983208:3310:1875503677003904:0@lo:400:kworker.0 00000100:00100000:3.0:1788620001.727877:0:3309:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333902c4700 x1875503677004672/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620001.727917:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42040134-1c22-4778-8507-c9e1e3983208:3308:1875503677004672:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788620001.727957:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875503677004672 offset 0 length 520: 4 00000100:00100000:3.0:1788620001.728008:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42040134-1c22-4778-8507-c9e1e3983208:3309:1875503677004544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620001.735922:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788620001.742623:0:7636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875503677004288 offset 224 length 224: 4 00000100:00100000:2.0:1788620001.742763:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387304450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1875503677004288:12345-0@lo:103:ldlm_bl.0 Request processed in 38133us (38393us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788620001.742799:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:0.0:1788620001.758951:0:13233:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788620001.784853:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbded0 00000020:00000080:3.0:1788620001.784863:0:13233:0:(genops.c:885:class_export_put()) final put ffff9333bbf29000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788620001.784910:0:13233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333bbf76000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788620001.784914:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333bbf76000 2 00000020:01000004:3.0:1788620001.784917:0:13233:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9333bbf76000 from lustre-OST0000 00000020:00000080:3.0:1788620001.784942:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620001.784951:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788620001.784954:0:13233:0:(genops.c:885:class_export_put()) final put ffff9333bbf2c000/lustre-OST0000_UUID 00000020:00000080:3.0:1788620001.784957:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbf2c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788620001.784967:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788620001.785005:0:13233:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788620001.785010:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788620001.785013:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620001.785017:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788620001.785025:0:13233:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9333c1e07000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620001.785030:0:13233:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9333bd1d3380) has exports, disconnecting them 00000020:00080000:3.0:1788620001.785035:0:13233:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9333c1e07000), last request at 1788619782 00000020:00000080:3.0:1788620001.785039:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdefa 00000020:00080000:3.0:1788620001.785048:0:13233:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333c1e07000): rc 0 00000020:00000080:3.0:1788620001.785052:0:13233:0:(genops.c:885:class_export_put()) final put ffff9333c1e07000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788620001.785165:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbf29000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788620001.785499:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333c1e07000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788620001.786815:0:13233:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788620001.786822:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620001.786826:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788620001.786832:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788620001.786989:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620001.786996:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788620001.787002:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333bbf76000 1 00000020:00000080:2.0:1788620001.787008:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbde8a 00000020:00000080:2.0:1788620001.787015:0:13233:0:(genops.c:885:class_export_put()) final put ffff9333bbd70000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788620001.787020:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788620001.787024:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620001.787027:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788620001.787031:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9333bd1d0000) has no exports 00000020:00000080:1.0:1788620001.787107:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333c1e01000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788620001.787123:0:496:0:(genops.c:885:class_export_put()) final put ffff9333c1e04000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788620001.787125:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333c1e04000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788620001.787131:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788620001.787178:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd70000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788620001.803152:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620001.803165:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788620001.803169:0:13233:0:(genops.c:885:class_export_put()) final put ffff933387579000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788620001.803173:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff933387579000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788620001.803183:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788620001.803292:0:13233:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9333bbf75800 00000020:02000400:1.0:1788620001.803336:0:13233:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788620002.771412:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620003.784909:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620004.807445:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788620004.898028:0:13384:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788620004.916021:0:13384:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788620004.916100:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.916114:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.916120:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.916140:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.916162:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788620004.916168:0:13384:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788620004.916194:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620004.916206:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff933285998a80 x1875503677004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620004.916226:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788620004.916232:0:13384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788620004.916238:0:13384:0:(import.c:65:import_set_state_nolock()) ffff933284eb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788620004.916242:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620004.916245:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff933285998a80 x1875503677004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620004.916251:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788620004.916254:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788620004.916284:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677004160:0@lo:38:kworker.0 00010000:00010000:0.0:1788620004.916361:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620004.916368:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620004.916377:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338a6eba00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788620004.916380:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620004.916388:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620004.916396:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620004.916402:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788620004.916404:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788620004.916406:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788620004.916419:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93338712c800 00010000:00010000:0.0:1788620004.916422:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620004.916429:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eba00/0xbb0e330328bbe0a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe0ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620004.916439:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620004.916441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620004.916443:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620004.917955:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.917973:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918081:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918088:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918146:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620004.918154:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918161:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918168:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620004.918174:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.921970:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620004.921990:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922131:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620004.922152:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922164:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620004.922172:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620004.922178:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620004.922181:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788620004.922194:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93338712c800 00010000:00010000:2.0:1788620004.922197:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922204:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18e800/0xbb0e330328bbe0b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe0ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922218:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620004.922221:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922227:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620004.922230:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922236:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620004.922242:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620004.922256:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788620004.922258:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788620004.922261:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93338712c800 00010000:00010000:2.0:1788620004.922264:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620004.922270:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620004.922272:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620004.922273:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620004.922377:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788620004.922384:0:13384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3400/0xbb0e330328bbe2f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe2ff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620004.922398:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788620004.922403:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788620004.922406:0:13384:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788620004.922435:0:13384:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788620004.922439:0:13384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788620004.922444:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620004.922450:0:13384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788620004.922454:0:13384:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9333a53a99c0) has no exports 00000020:00080000:3.0:1788620004.922474:0:13384:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9333a53a99c0) has no exports 00010000:00010000:0.0:1788620004.931545:0:7635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788620004.932570:0:13384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333bc7be6c0 - data ffff9333b38f0a20/ffff9333bc041800 00000020:01000000:2.0:1788620004.932712:0:13384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333874a5f60 - data ffff93339c691288/ffff9332865fc000 00100000:10000000:2.0:1788620004.948441:0:13384:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788620004.971720:0:13384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdfa9 00000020:00000080:0.0:1788620004.971731:0:13384:0:(genops.c:885:class_export_put()) final put ffff933284ead800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788620004.972090:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933284ead800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:0.0:1788620004.972239:0:13384:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333861ca800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788620004.972244:0:13384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333861ca800 2 00000020:01000004:0.0:1788620004.972247:0:13384:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9333861ca800 from lustre-OST0001 00000020:00000080:0.0:1788620004.972277:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620004.972288:0:13384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788620004.972291:0:13384:0:(genops.c:885:class_export_put()) final put ffff9333bbf77800/lustre-OST0001_UUID 00000020:00000080:0.0:1788620004.972294:0:13384:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbf77800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788620004.972304:0:13384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788620004.972394:0:13384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 42040134-1c22-4778-8507-c9e1e3983208->MGS 00010000:00010000:0.0:1788620004.972409:0:13384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93338a6eb200/0xbb0e330328bbdead lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620004.973668:0:13384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93338a6eb200/0xbb0e330328bbdead lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620004.973675:0:13384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788620004.973678:0:13384:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788620004.973682:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788620004.973700:0:13384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93338712c800 00010000:00010000:0.0:1788620004.973704:0:13384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93338a6eb200/0xbb0e330328bbdead lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbdeb4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620004.973751:0:13384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620004.973759:0:13384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620004.973765:0:13384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788620004.973767:0:13384:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788620004.973800:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788620004.973812:0:13384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93338712c800 00010000:00010000:0.0:1788620004.973815:0:13384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18f800/0xbb0e330328bbe0f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbe100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788620004.973832:0:13384:0:(import.c:65:import_set_state_nolock()) ffff93338712c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788620004.973837:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788620004.973839:0:13384:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788620004.973841:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788620004.973846:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788620004.973867:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333902c4700 x1875503677004672/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788620011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788620004.973902:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788620004.973905:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1788620004.973988:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42040134-1c22-4778-8507-c9e1e3983208:3308:1875503677004672:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788620004.974238:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788620004.974246:0:13384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdd9c 00000020:00000080:0.0:1788620004.974253:0:13384:0:(genops.c:885:class_export_put()) final put ffff93338712a800/42040134-1c22-4778-8507-c9e1e3983208 00000020:01000000:0.0:1788620004.974269:0:13384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:0.0:1788620004.974276:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620004.974282:0:13384:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788620004.974287:0:13384:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9333871319c0) has no exports 00000020:00000080:3.0:1788620004.974317:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff93338712a800/42040134-1c22-4778-8507-c9e1e3983208 for MGC192.168.203.112@tcp 10000000:01000000:2.0:1788620004.974358:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788620004.974508:0:13384:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:0.0:1788620004.974512:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788620004.974514:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788620004.974516:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788620004.974518:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788620004.974561:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620004.974567:0:13384:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid 42040134-1c22-4778-8507-c9e1e3983208) 00000020:01000000:0.0:1788620004.974573:0:13384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788620004.974576:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620004.974581:0:13384:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788620004.974586:0:13384:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9332849a2800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:3.0:1788620004.974598:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93338712c800 for MGC192.168.203.112@tcp 00000020:00080000:0.0:1788620004.974599:0:13384:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9332849c8000) has exports, disconnecting them 00000020:00000080:3.0:1788620004.974604:0:13043:0:(genops.c:885:class_export_put()) final put ffff93338712b800/42040134-1c22-4778-8507-c9e1e3983208 00000020:00080000:0.0:1788620004.974604:0:13384:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9332849a2800), last request at 1788619800 00000020:00000080:3.0:1788620004.974606:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff93338712b800/42040134-1c22-4778-8507-c9e1e3983208 for MGC192.168.203.112@tcp 00000020:00000080:0.0:1788620004.974608:0:13384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdfd3 00000020:01000000:3.0:1788620004.974610:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (42040134-1c22-4778-8507-c9e1e3983208) 00000020:00080000:0.0:1788620004.974617:0:13384:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9332849a2800): rc 0 00000020:00000080:0.0:1788620004.974620:0:13384:0:(genops.c:885:class_export_put()) final put ffff9332849a2800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788620004.981849:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a2800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788620004.983262:0:13384:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788620004.983268:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620004.983273:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788620004.983279:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788620004.983341:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788620004.983457:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284eb7000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788620005.017860:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788620005.018165:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788620005.018434:0:7635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788620005.018602:0:11679:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9333bb912000:11679] 2 exiting: rc = 0 00000100:00100000:2.0:1788620005.018750:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff933391821800:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1788620005.019275:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff933392e8a600:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1788620005.020048:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.020521:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9333aff37e00:5827] 2 exiting: rc = 0 00000100:00100000:2.0:1788620005.020595:0:7636:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93328492fa00:7636] 3 exiting: rc = 0 00000100:00100000:1.0:1788620005.023253:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9333aff37400:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1788620005.023542:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9333ad378e00:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788620005.023813:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023822:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023830:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023836:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023841:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023847:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023853:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023858:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023863:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023869:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023876:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023893:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023898:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023905:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023911:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023917:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023923:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023930:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023935:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023940:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023945:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023952:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023957:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023962:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023979:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023984:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023989:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.023994:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024000:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024005:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024010:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024015:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024020:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024025:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024030:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024036:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024041:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024046:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024052:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024057:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024062:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024067:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024072:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024077:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024082:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024087:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024092:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024097:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024103:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024108:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024113:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024118:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024125:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024130:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024136:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024141:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024146:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024151:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024157:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024170:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024175:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024180:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024186:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.024191:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788620005.027158:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620005.027171:0:13384:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788620005.027176:0:13384:0:(genops.c:885:class_export_put()) final put ffff933284eb5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788620005.027181:0:13384:0:(genops.c:844:class_export_destroy()) destroying export ffff933284eb5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788620005.027187:0:13384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788620005.027233:0:13384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333861ca800 1 00000020:00000080:3.0:1788620005.027239:0:13384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbdf78 00000020:00000080:3.0:1788620005.027245:0:13384:0:(genops.c:885:class_export_put()) final put ffff9333861c9000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788620005.027256:0:13384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788620005.027261:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620005.027265:0:13384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788620005.027268:0:13384:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9333bd343380) has no exports 00000020:00000080:2.0:1788620005.027370:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333861c9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788620005.067741:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620005.067757:0:13384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788620005.067763:0:13384:0:(genops.c:885:class_export_put()) final put ffff933387160000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788620005.067767:0:13384:0:(genops.c:844:class_export_destroy()) destroying export ffff933387160000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788620005.067794:0:13384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788620005.068055:0:13384:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933387161000 00000020:01000000:3.0:1788620005.068078:0:13384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788620005.068083:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620005.068087:0:13384:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788620005.068091:0:13384:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93338745cd40) has no exports 00000020:00000080:3.0:1788620005.068109:0:13384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620005.068114:0:13384:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788620005.068116:0:13384:0:(genops.c:885:class_export_put()) final put ffff9333bbd72000/OSS_uuid 00000020:00000080:3.0:1788620005.068119:0:13384:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd72000/OSS_uuid for OSS 00000020:01000000:3.0:1788620005.068122:0:13384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788620005.068192:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9333bc4ee200:6692] 2 exiting: rc = 0 00000100:00080000:3.0:1788620005.070099:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788620005.076144:0:8933:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9333acee9c00:8933] 3 exiting: rc = 0 00000100:00100000:0.0:1788620005.076266:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93339306d000:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1788620005.076732:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9333baffa600:6689] 0 exiting: rc = 1 00000100:00100000:3.0:1788620005.085552:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085563:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085581:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085588:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085593:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085597:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085602:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085606:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085611:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085616:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085621:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085626:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085631:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085635:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085640:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085645:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085650:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085655:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085660:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085665:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085670:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085674:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085679:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085684:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085690:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085695:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085701:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085706:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085714:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085720:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085724:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085729:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085733:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085738:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085757:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085761:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085767:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085788:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085794:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085799:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085805:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085810:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085815:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085821:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085826:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085830:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085835:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085839:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085844:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085849:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085855:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085859:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085864:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085870:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085876:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085892:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085897:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085902:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085907:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085912:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085917:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085922:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085927:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.085938:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.086934:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff933387407600:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1788620005.088204:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff933387406a00:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1788620005.088286:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088294:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088299:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088316:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088321:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088326:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088331:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088336:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088341:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088346:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088351:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088356:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088362:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088367:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088372:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088377:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088382:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088386:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088391:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088396:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088401:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.088406:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089228:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089243:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089249:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089253:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089258:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089262:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089267:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089271:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089275:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089280:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089285:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089289:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089295:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089299:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089304:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089310:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089327:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089331:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089336:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089340:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089345:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089350:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089354:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089358:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089362:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089367:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089371:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089376:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089382:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089386:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089391:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089395:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089400:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089404:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.089409:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090091:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090098:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090103:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090107:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090112:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090117:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.090122:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620005.097512:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff933392575e00:6697] 2 exiting: rc = 0 00000100:00100000:0.0:1788620005.101364:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93338350e400:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1788620005.101761:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93338350fc00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1788620005.103568:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103578:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103584:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103590:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103598:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103603:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103608:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103613:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103618:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103640:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103645:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103651:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103656:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103661:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103666:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103672:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103677:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103682:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103688:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103693:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103697:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103703:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103708:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103713:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103717:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103722:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103727:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103750:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103757:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103761:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103766:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103788:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103793:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103799:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103803:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103808:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103814:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103819:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103824:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103829:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103833:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103838:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103844:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103849:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103862:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103867:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103872:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103877:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103891:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103897:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103902:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103907:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103912:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103917:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103922:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103928:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103948:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103955:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103961:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103966:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.103973:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.105631:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.105644:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620005.105650:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620005.116547:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9333bc4eee00:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1788620005.120566:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9333bc4eea00:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1788620005.120713:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120721:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120726:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120732:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120738:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120743:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120748:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120753:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120758:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120763:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120768:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120795:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120800:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120806:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120812:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120817:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120822:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120827:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120832:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120838:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120843:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120858:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120929:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120937:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120941:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120946:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120952:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120958:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120963:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120968:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120973:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120978:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120983:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120988:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120994:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.120999:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121004:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121009:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121014:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121019:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121024:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121029:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121034:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121039:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121044:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121049:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121055:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121059:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121064:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121069:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121075:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121080:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121086:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121091:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121095:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121100:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121105:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121118:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121123:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121128:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121133:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121138:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121143:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620005.121149:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620005.121895:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9333bbf22a00:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1788620005.121959:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9333bc8c8000:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1788620005.126018:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126043:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126059:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126075:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126083:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126088:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126094:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126100:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126106:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126111:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126116:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126122:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126129:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126135:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126142:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126162:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126170:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126176:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126182:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126190:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126196:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126202:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126208:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126216:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126222:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126230:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126236:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126259:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126266:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126271:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126276:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126282:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126299:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126313:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126319:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126325:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126338:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126343:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126349:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126370:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126378:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126383:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126389:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126395:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126402:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126408:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126414:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126420:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126426:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126432:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126438:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126457:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126465:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126471:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126477:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126484:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126490:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126495:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126501:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126517:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126524:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126530:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126536:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620005.126556:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788620005.150648:0:13384:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788620023.406439:0:13998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788620031.996594:0:14461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788620031.996601:0:14461:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788620031.996739:0:14461:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933384eee800 00000020:01000004:3.0:1788620031.996754:0:14461:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788620031.996761:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788620031.996971:0:14461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9333bd343380) 00000020:00000080:3.0:1788620031.996985:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788620032.031419:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788620032.036063:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788620032.036944:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 357: rc = 0 00100000:10000000:2.0:1788620032.037109:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 357: rc = 0 00100000:10000000:2.0:1788620032.037201:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788620032.037390:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788620032.039072:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 357: rc = 0 00100000:10000000:2.0:1788620032.039206:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 357: rc = 0 00100000:10000000:2.0:1788620032.041204:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 357: rc = 0 00100000:10000000:2.0:1788620032.043849:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 359: rc = 0 00100000:10000000:2.0:1788620032.053605:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:2.0:1788620032.053714:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:2.0:1788620032.054235:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.054485:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1788620032.054747:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1788620032.055056:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1788620032.055302:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.055534:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.058175:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.058474:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:2.0:1788620032.058727:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.059016:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:2.0:1788620032.059260:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1788620032.059518:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:2.0:1788620032.059991:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 528: rc = 0 00100000:10000000:2.0:1788620032.060230:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 528: rc = 0 00100000:10000000:2.0:1788620032.060514:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 528: rc = 0 00100000:10000000:2.0:1788620032.060820:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 528: rc = 0 00100000:10000000:2.0:1788620032.061065:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 528: rc = 0 00100000:10000000:2.0:1788620032.061306:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 528: rc = 0 00100000:10000000:2.0:1788620032.061559:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 528: rc = 0 00100000:10000000:3.0:1788620032.065394:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 528: rc = 0 00100000:10000000:3.0:1788620032.066373:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 528: rc = 0 00100000:10000000:3.0:1788620032.069322:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 528: rc = 0 00100000:10000000:3.0:1788620032.069850:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 528: rc = 0 00100000:10000000:3.0:1788620032.070815:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 528: rc = 0 00100000:10000000:3.0:1788620032.071090:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 528: rc = 0 00100000:10000000:3.0:1788620032.071351:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 528: rc = 0 00100000:10000000:3.0:1788620032.071589:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 528: rc = 0 00100000:10000000:3.0:1788620032.072684:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 528: rc = 0 00100000:10000000:3.0:1788620032.073606:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 528: rc = 0 00100000:10000000:3.0:1788620032.075147:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 528: rc = 0 00100000:10000000:3.0:1788620032.077043:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 528: rc = 0 00100000:10000000:3.0:1788620032.077367:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 528: rc = 0 00100000:10000000:3.0:1788620032.080896:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 528: rc = 0 00100000:10000000:3.0:1788620032.081201:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 528: rc = 0 00100000:10000000:3.0:1788620032.081430:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 528: rc = 0 00100000:10000000:3.0:1788620032.081679:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 528: rc = 0 00100000:10000000:3.0:1788620032.082636:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 528: rc = 0 00100000:10000000:3.0:1788620032.083043:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 528: rc = 0 00100000:10000000:3.0:1788620032.083283:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 528: rc = 0 00100000:10000000:3.0:1788620032.087372:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 528: rc = 0 00100000:10000000:3.0:1788620032.088026:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 528: rc = 0 00100000:10000000:3.0:1788620032.088294:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 528: rc = 0 00100000:10000000:3.0:1788620032.088543:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 528: rc = 0 00100000:10000000:3.0:1788620032.088817:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 528: rc = 0 00100000:10000000:3.0:1788620032.090229:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 502: rc = 0 00100000:10000000:3.0:1788620032.090799:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788620032.091285:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1788620032.091541:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788620032.091604:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1788620032.092304:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788620032.092378:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:3.0:1788620032.092791:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788620032.092881:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 516: rc = 0 00100000:10000000:3.0:1788620032.093140:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788620032.093213:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 516: rc = 0 00100000:10000000:3.0:1788620032.093421:0:14461:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788620032.093491:0:14461:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 516: rc = 0 00000020:00000080:3.0:1788620032.093752:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788620032.093760:0:14461:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788620032.093769:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf09d 00000020:01000004:3.0:1788620032.093812:0:14461:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788620032.093817:0:14461:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788620032.093823:0:14461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933384eee800 from MGS 00000020:01000004:3.0:1788620032.093826:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788620032.093835:0:14461:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9333bd344d40) 00000020:00000080:3.0:1788620032.093845:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788620032.093895:0:14461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933384eee800 from MGS, refs=2 00080000:01000000:3.0:1788620032.093900:0:14461:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788620032.093904:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf0ab 00000100:00100000:3.0:1788620032.094283:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788620032.094479:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788620032.094486:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788620032.100274:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788620032.100288:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788620032.101176:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620032.101362:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788620032.101368:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788620032.103978:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788620032.103992:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788620032.110213:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788620032.110225:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788620032.115215:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620032.115221:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620032.115967:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620032.116893:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620032.116897:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620032.116900:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620032.118411:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788620032.123654:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788620032.147112:0:14461:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788620032.147141:0:14461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788620032.147144:0:14461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788620032.158319:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788620032.159047:0:14461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788620032.159159:0:14461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788620032.167159:0:14461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788620032.168354:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620032.168526:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788620032.168533:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788620032.169754:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788620032.169764:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788620032.170342:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788620032.170349:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788620032.172413:0:14475:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788620032.172437:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788620032.172459:0:14461:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:0.0:1788620032.172461:0:14461:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788620032.172492:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:0.0:1788620032.172505:0:14461:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff9333bd1d4d40) 00000020:00000080:0.0:1788620032.172520:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788620032.172957:0:14461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333bc069000@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788620032.173105:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:0.0:1788620032.173111:0:14461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788620032.174953:0:14476:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788620032.175052:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 937205a0-294a-4965-a8b3-aa80c7ce7507) 00000020:00000080:0.0:1788620032.175071:0:14461:0:(genops.c:1385:class_connect()) connect: client 937205a0-294a-4965-a8b3-aa80c7ce7507, cookie 0xbb0e330328bbf0b9 00000100:00080000:0.0:1788620032.175083:0:14461:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620032.175090:0:14461:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff9333bc069000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620032.175122:0:14461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bc10ed80 x1875503677004800/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620032.175183:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677004800:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788620032.175258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.175349:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677004800 00000100:00100000:2.0:1788620032.175356:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677004800 00000100:00100000:2.0:1788620032.175388:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620032.175395:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1875503677004800:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788620032.175417:0:14472:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 937205a0-294a-4965-a8b3-aa80c7ce7507@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1788620032.175438:0:14472:0:(genops.c:1385:class_connect()) connect: client 937205a0-294a-4965-a8b3-aa80c7ce7507, cookie 0xbb0e330328bbf0c0 00000100:00080000:2.0:1788620032.175552:0:14472:0:(import.c:65:import_set_state_nolock()) ffff9333bc14b800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788620032.175673:0:14461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS 00000020:01000004:0.0:1788620032.175700:0:14461:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788620032.175706:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788620032.175718:0:14461:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9333bd1d19c0) 00000020:00000080:0.0:1788620032.175728:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788620032.182368:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+5:3308:x1875503677004800:12345-0@lo:250:mount.lustre.0 Request processed in 6961us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.182384:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620032.182529:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788620032.182541:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1788620032.182550:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788620032.182555:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788620032.182559:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788620032.182672:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788620032.182689:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788620032.182704:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677004800:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788620032.189124:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620032.190467:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788620032.190480:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788620032.199190:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788620032.199205:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788620032.199901:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788620032.199909:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788620032.201003:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620032.201162:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788620032.201167:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788620032.207718:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788620032.207799:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788620032.288514:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620032.288715:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788620032.288721:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788620032.291651:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788620032.291665:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788620032.292361:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620032.292515:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620032.292519:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788620032.293211:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788620032.293219:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788620032.293675:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620032.293863:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620032.293870:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788620032.295281:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788620032.295291:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788620032.298818:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620032.299432:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620032.299441:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788620032.301286:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788620032.301299:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788620032.372521:0:14461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620032.372982:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788620032.372988:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788620032.375002:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788620032.375013:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788620032.376733:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620032.376747:0:14461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788620032.377609:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788620032.377630:0:14461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788620032.377635:0:14461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788620032.377811:0:14461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788620032.377851:0:14461:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788620032.378011:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788620032.378013:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620032.378014:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620032.378015:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620032.378017:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620032.378018:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620032.378019:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620032.378021:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620032.378023:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620032.378024:0:14461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620032.378026:0:14461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788620032.378029:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620032.378030:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620032.378031:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620032.378033:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620032.378033:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620032.378035:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620032.378036:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620032.378037:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620032.378038:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620032.378039:0:14461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620032.378563:0:14461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788620032.378583:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677004928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788620032.378648:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.378710:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387281000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.379989:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677004928 00000100:00100000:3.0:1788620032.379999:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677004928 00000100:00100000:3.0:1788620032.380048:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620032.380182:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+5:14461:x1875503677004928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788620032.380236:0:14474:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788620032.380243:0:14474:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788620032.380246:0:14474:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788620032.381679:0:14495:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788620032.382123:0:14474:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788620032.384704:0:14496:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788620032.384712:0:14496:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788620032.384715:0:14496:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788620032.384749:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788620032.385166:0:14474:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788620032.385180:0:14474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788620032.393468:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+5:14461:x1875503677004928:12345-0@lo:253:mount.lustre.0 Request processed in 13280us (14811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.393481:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620032.393747:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677004928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788620032.393761:0:14461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788620032.393764:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788620032.393766:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620032.393767:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620032.393768:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620032.393796:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620032.393797:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620032.393799:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620032.393801:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620032.393802:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620032.393804:0:14461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788620032.393822:0:14461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933384eee800 from lustre-MDT0000 10000000:01000000:1.0:1788620032.393846:0:14461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788620032.393849:0:14461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788620032.393853:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9333bd1d4d40 10000000:01000000:1.0:1788620032.393865:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620032.393872:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9333bd1d4d40 from 1 10000000:01000000:1.0:1788620032.393875:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788620032.393908:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.393919:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.393928:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620032.393946:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620032.393993:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.394026:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.394103:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005056 00000100:00100000:3.0:1788620032.394109:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005056 00000100:00100000:3.0:1788620032.394141:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620032.394149:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+5:14461:x1875503677005056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620032.394161:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620032.394175:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbf0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf0ce expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.394197:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbf0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf0ce expref: 6 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.394207:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbf0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf0ce expref: 6 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.394216:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:3.0:1788620032.394264:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+6:14461:x1875503677005056:12345-0@lo:101:mount.lustre.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.394270:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620032.394431:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620032.394444:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.394453:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620032.394499:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620032.394524:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.394550:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620032.394607:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005184 00000100:00100000:2.0:1788620032.394611:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005184 00000100:00100000:2.0:1788620032.394643:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620032.394650:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+6:14461:x1875503677005184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.394900:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+6:14461:x1875503677005184:12345-0@lo:501:mount.lustre.0 Request processed in 250us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620032.394907:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620032.395219:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005184:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788620032.395256:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788620032.395274:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395283:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620032.395291:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933384eee800 10000000:01000000:1.0:1788620032.395295:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788620032.395298:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff933384eee800 10000000:01000000:1.0:1788620032.395300:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788620032.395303:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff933384eee800 from 1 10000000:01000000:1.0:1788620032.395305:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788620032.395321:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395335:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395343:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620032.395356:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620032.395382:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.395410:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.395547:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005312 00000100:00100000:3.0:1788620032.395551:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005312 00000100:00100000:3.0:1788620032.395582:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620032.395588:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+6:14461:x1875503677005312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620032.395596:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620032.395614:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0e00/0xbb0e330328bbf0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf0dc expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.395630:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0e00/0xbb0e330328bbf0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf0dc expref: 7 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.395639:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0e00/0xbb0e330328bbf0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf0dc expref: 7 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.395646:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0e00, rc 0) 00000100:00100000:3.0:1788620032.395684:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+7:14461:x1875503677005312:12345-0@lo:101:mount.lustre.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.395699:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620032.395809:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620032.395821:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395829:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620032.395840:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788620032.395862:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395869:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620032.395875:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788620032.395879:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620032.395883:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff933384eee800 10000000:01000000:1.0:1788620032.395885:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788620032.395893:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788620032.395894:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788620032.395907:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395914:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.395921:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620032.395933:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620032.395958:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.395977:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.396186:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005440 00000100:00100000:3.0:1788620032.396190:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005440 00000100:00100000:3.0:1788620032.396218:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620032.396360:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+7:14461:x1875503677005440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620032.396367:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620032.396375:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbf0f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf0ea expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.396387:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbf0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf0ea expref: 8 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.396395:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbf0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf0ea expref: 8 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.396401:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1c00, rc 0) 00000100:00100000:3.0:1788620032.396436:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+8:14461:x1875503677005440:12345-0@lo:101:mount.lustre.0 Request processed in 80us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.396490:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620032.396500:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.396508:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620032.396545:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620032.396569:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.396592:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620032.397012:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005568 00000100:00100000:2.0:1788620032.397017:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005568 00000100:00100000:2.0:1788620032.397037:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620032.397043:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14461:x1875503677005568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.397441:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+10:14461:x1875503677005568:12345-0@lo:501:mount.lustre.0 Request processed in 397us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.397450:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620032.397540:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620032.398183:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620032.398228:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620032.398334:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.398382:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.398407:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005696 00000100:00100000:0.0:1788620032.398413:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005696 00000100:00100000:0.0:1788620032.398467:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620032.398474:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14461:x1875503677005696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620032.398821:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14461:x1875503677005696:12345-0@lo:503:mount.lustre.0 Request processed in 348us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620032.398829:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620032.399055:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677005696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620032.400811:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14497:1875503677005824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620032.400881:0:14497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.400915:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.401141:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677005824 00000100:00100000:3.0:1788620032.401148:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677005824 00000100:00100000:3.0:1788620032.401189:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620032.401197:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14497:x1875503677005824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620032.401492:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14497:x1875503677005824:12345-0@lo:502:llog_process_th.0 Request processed in 296us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.401500:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620032.401851:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14497:1875503677005824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620032.401942:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620032.401953:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.401955:0:14497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788620032.401960:0:14497:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788620032.401963:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788620032.401976:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9333a53ab380) 00000020:00000080:1.0:1788620032.401991:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788620032.401997:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788620032.402055:0:14497:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788620032.402061:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf0ff 00000020:00000080:1.0:1788620032.402978:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788620032.402984:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620032.402988:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.402990:0:14497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788620032.402993:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620032.402997:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.402998:0:14497:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788620032.403001:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788620032.403010:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9333a53a8000) 00000020:00000080:1.0:1788620032.403022:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788620032.403026:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788620032.403028:0:14497:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788620032.403031:0:14497:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788620032.403037:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788620032.403109:0:14497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933384eee800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788620032.403122:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9333a53a99c0) 00000020:00000080:1.0:1788620032.403131:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788620032.403180:0:14497:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788620032.403185:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf114 00000020:00000080:1.0:1788620032.403381:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788620032.403389:0:14497:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788620032.403393:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb0e330328bbf11b 00080000:01000000:1.0:1788620032.403399:0:14497:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788620032.403402:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf122 00010000:00010000:1.0:1788620032.481490:0:14497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788620032.482161:0:14497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788620032.482338:0:14497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788620032.482996:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9333a53acd40) 00000020:00000080:1.0:1788620032.483018:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788620032.483088:0:14497:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788620032.483095:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf130 00000020:00000080:2.0:1788620032.485009:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788620032.487757:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb0e330328bbf137 00000020:00000080:1.0:1788620032.491715:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788620032.491727:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620032.491733:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.491736:0:14497:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788620032.491739:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788620032.491742:0:14497:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788620032.491743:0:14497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788620032.491745:0:14497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788620032.491746:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788620032.491749:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.491755:0:14497:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788620032.491758:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620032.491762:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620032.491763:0:14497:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788620032.491767:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788620032.492213:0:14497:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788620032.492232:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620032.492235:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620032.492237:0:14497:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788620032.492239:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788620032.492243:0:14497:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788620032.492246:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620032.492247:0:14497:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788620032.492251:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788620032.492256:0:14497:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1788620032.492281:0:14497:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788620032.492285:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788620032.492299:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9333bd1d0000) 00000020:00000080:0.0:1788620032.492315:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788620032.492319:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788620032.492370:0:14497:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788620032.492375:0:14497:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788620032.492381:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf145 00010000:00080000:0.0:1788620032.492440:0:14497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333a53c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788620032.492649:0:14497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788620032.493652:0:14497:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788620032.493708:0:14497:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788620032.495032:0:14497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620032.495096:0:14497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788620032.495177:0:14497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788620032.495582:0:14501:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788620032.495587:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788620032.510377:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620032.510391:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788620032.510427:0:14497:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788620032.510445:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf14c 00000100:00080000:3.0:1788620032.510454:0:14497:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788620032.510460:0:14497:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333a53c0000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620032.510493:0:14497:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333902c4700 x1875503677005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788620032.510524:0:14497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788620032.510567:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620032.510571:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620032.510573:0:14497:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788620032.510575:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788620032.510578:0:14497:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788620032.510580:0:14497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620032.510582:0:14497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620032.510583:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788620032.510585:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620032.510587:0:14497:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788620032.510589:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788620032.510593:0:14497:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788620032.510608:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620032.510609:0:14497:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788620032.510613:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788620032.510616:0:14497:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788620032.510637:0:14497:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788620032.510640:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620032.510650:0:14497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9333bd3419c0) 00000020:00000080:3.0:1788620032.510660:0:14497:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788620032.510664:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788620032.510737:0:14497:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788620032.510742:0:14497:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788620032.510748:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf15a 00010000:00080000:3.0:1788620032.510802:0:14497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933385805800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788620032.510986:0:14497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788620032.511145:0:14497:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788620032.511164:0:14497:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788620032.511811:0:14497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620032.511878:0:14497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788620032.511956:0:14497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1788620032.512282:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677005952:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788620032.512333:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677005952 offset 0 length 520: 4 00000040:00080000:3.0:1788620032.513380:0:14503:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788620032.513385:0:14503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788620032.515369:0:14497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788620032.515394:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788620032.515434:0:14497:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788620032.515453:0:14497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf161 00000100:00080000:2.0:1788620032.515464:0:14497:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620032.515470:0:14497:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385805800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788620032.515503:0:14497:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333c1ed9c00 x1875503677006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788620032.515646:0:14497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788620032.515707:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620032.515711:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.515713:0:14497:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788620032.515716:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620032.515720:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.515721:0:14497:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788620032.515724:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788620032.515726:0:14497:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788620032.515728:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620032.515730:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.515731:0:14497:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788620032.515733:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620032.515735:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.515736:0:14497:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788620032.515739:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788620032.515741:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677006080:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788620032.515766:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14497:1875503677006208:0@lo:502:llog_process_th.0 00000400:00000100:3.0:1788620032.515818:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677006080 offset 0 length 520: 4 00000100:00100000:2.0:1788620032.516101:0:14497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.516127:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333882fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.516168:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006208 00000100:00100000:0.0:1788620032.516175:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006208 00000100:00100000:0.0:1788620032.516248:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620032.516256:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14497:x1875503677006208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620032.516477:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14497:x1875503677006208:12345-0@lo:502:llog_process_th.0 Request processed in 221us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620032.516485:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620032.516561:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14497:1875503677006208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620032.516587:0:14497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620032.516593:0:14497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620032.516595:0:14497:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620032.516602:0:14497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788620032.516749:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788620032.516766:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788620032.516802:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.516826:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620032.516833:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933384eee800 from 1 10000000:01000000:2.0:1788620032.516836:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620032.516859:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.516866:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.516875:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.516888:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620032.516913:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.516930:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.517753:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006336 00000100:00100000:0.0:1788620032.517760:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006336 00000100:00100000:2.0:1788620032.518111:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620032.518120:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+9:14461:x1875503677006336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620032.518132:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620032.518146:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf168 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.518168:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 10 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.518179:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 10 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.518200:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6e00, rc 0) 00000100:00100000:2.0:1788620032.518298:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+10:14461:x1875503677006336:12345-0@lo:101:mount.lustre.0 Request processed in 179us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.518305:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788620032.518421:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620032.518442:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.518451:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620032.519634:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006464:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788620032.519683:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620032.519728:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.519841:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006464 00000100:00100000:3.0:1788620032.519853:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006464 00000100:00100000:3.0:1788620032.519898:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620032.519906:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+10:14461:x1875503677006464:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788620032.519923:0:14472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788620032.519928:0:14472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788620032.519997:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+10:14461:x1875503677006464:12345-0@lo:256:mount.lustre.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.520004:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620032.520009:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006464:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788620032.520748:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788620032.521044:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.521055:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620032.521063:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933384eee800 from 1 10000000:01000000:0.0:1788620032.521065:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620032.521094:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.521102:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.521112:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620032.521187:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620032.521228:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620032.521339:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.521723:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006592 00000100:00100000:3.0:1788620032.521730:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006592 00000100:00100000:3.0:1788620032.522038:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620032.522050:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+10:14461:x1875503677006592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620032.522061:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620032.522075:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf176 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.522099:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.522109:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.522117:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0000, rc 0) 00000100:00100000:3.0:1788620032.522166:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677006592:12345-0@lo:101:mount.lustre.0 Request processed in 118us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.522172:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620032.522204:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620032.522219:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.522238:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.522288:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.522307:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.522330:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.522337:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006720 00000100:00100000:3.0:1788620032.522341:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006720 00000100:00100000:3.0:1788620032.522403:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620032.522418:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677006720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620032.522765:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677006720:12345-0@lo:501:mount.lustre.0 Request processed in 347us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.522947:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.522978:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620032.523012:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620032.523062:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620032.523979:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.524013:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006848 00000100:00100000:3.0:1788620032.524019:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006848 00000100:00100000:1.0:1788620032.524073:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620032.524083:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677006848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620032.524323:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677006848:12345-0@lo:503:mount.lustre.0 Request processed in 242us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.524329:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620032.524394:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677006848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620032.524972:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14505:1875503677006976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620032.525013:0:14505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.525043:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.525578:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677006976 00000100:00100000:3.0:1788620032.525586:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677006976 00000100:00100000:3.0:1788620032.525631:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620032.525639:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14505:x1875503677006976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620032.526092:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14505:x1875503677006976:12345-0@lo:502:llog_process_th.0 Request processed in 452us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.526101:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788620032.526276:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14505:1875503677006976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620032.526313:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620032.526321:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.526323:0:14505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788620032.526329:0:14505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933384eee800 00000020:00000080:2.0:1788620032.526332:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620032.526338:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620032.526340:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.526342:0:14505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788620032.526344:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620032.526346:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.526347:0:14505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788620032.526350:0:14505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933384eee800 00000020:00000080:2.0:1788620032.526352:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620032.526454:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620032.526458:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.526459:0:14505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788620032.526461:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620032.526464:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.526465:0:14505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788620032.526467:0:14505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933384eee800 00000020:00000080:2.0:1788620032.526469:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788620032.527782:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14505:1875503677007104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620032.527858:0:14505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.527897:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333913cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.527916:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007104 00000100:00100000:0.0:1788620032.527923:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007104 00000100:00100000:0.0:1788620032.527966:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788620032.527976:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14505:x1875503677007104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620032.528193:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14505:x1875503677007104:12345-0@lo:502:llog_process_th.0 Request processed in 217us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620032.528201:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620032.528305:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14505:1875503677007104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620032.528341:0:14505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620032.528348:0:14505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620032.528359:0:14505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788620032.528363:0:14505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788620032.528503:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788620032.528520:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620032.528542:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.528553:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620032.528590:0:14461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788620032.528594:0:14461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933384eee800 10000000:01000000:0.0:1788620032.528596:0:14461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933384eee800 10000000:01000000:0.0:1788620032.528600:0:14461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620032.528606:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933384eee800 from 1 10000000:01000000:0.0:1788620032.528608:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788620032.528632:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.528641:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.528654:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620032.528668:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620032.528712:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620032.528731:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620032.529190:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007232 00000100:00100000:3.0:1788620032.529195:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007232 00000100:00100000:3.0:1788620032.529264:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788620032.529272:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677007232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620032.529282:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620032.529295:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0600/0xbb0e330328bbf18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf184 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.529317:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0600/0xbb0e330328bbf18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf184 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.529328:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0600/0xbb0e330328bbf18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf184 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.529336:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0600, rc 0) 00000100:00100000:3.0:1788620032.529385:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677007232:12345-0@lo:101:mount.lustre.0 Request processed in 114us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620032.529392:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788620032.529407:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620032.529423:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620032.529433:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620032.529477:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620032.529506:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620032.529577:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620032.529888:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007360 00000100:00100000:2.0:1788620032.529902:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007360 00000100:00100000:2.0:1788620032.530027:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620032.530034:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677007360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.530266:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677007360:12345-0@lo:501:mount.lustre.0 Request processed in 233us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.530271:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620032.530336:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620032.530370:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620032.530415:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.530478:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333913cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.530513:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007488 00000100:00100000:0.0:1788620032.530517:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007488 00000100:00100000:0.0:1788620032.530568:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788620032.530575:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677007488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620032.530746:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677007488:12345-0@lo:503:mount.lustre.0 Request processed in 171us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620032.530753:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620032.530986:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677007488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620032.532028:0:14508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14508:1875503677007616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620032.532085:0:14508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620032.532135:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007616 00000100:00100000:0.0:1788620032.532137:0:14508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620032.532143:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007616 00000100:00100000:1.0:1788620032.532182:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620032.532190:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14508:x1875503677007616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620032.532408:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14508:x1875503677007616:12345-0@lo:502:llog_process_th.0 Request processed in 217us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.532415:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620032.532451:0:14508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14508:1875503677007616:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788620032.532518:0:14508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788620032.532532:0:14508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9333bd1d3380) 00000020:00000080:0.0:1788620032.532549:0:14508:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788620032.532668:0:14508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933384eee800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620032.532673:0:14508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933384eee800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620032.532676:0:14508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933384eee800 4 00010000:00080000:0.0:1788620032.532729:0:14508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333836dc000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788620032.534623:0:14508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788620032.537378:0:14508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788620032.537766:0:14508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788620032.537846:0:14508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb0e330328bbf199 00000100:00080000:0.0:1788620032.537858:0:14508:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620032.537863:0:14508:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9333836dc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620032.537896:0:14508:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bc10c700 x1875503677007744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620032.537930:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677007744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788620032.537986:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788620032.538725:0:14508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788620032.539039:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007744 00000100:00100000:0.0:1788620032.539048:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007744 00000100:00100000:0.0:1788620032.539352:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620032.539361:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677007744:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788620032.539436:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677007744:12345-0@lo:38:llog_process_th.0 Request processed in 74us (1449us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788620032.539445:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620032.539498:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620032.539506:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333836dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788620032.539510:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788620032.539515:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677007744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788620032.539796:0:14508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14508:1875503677007872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620032.539841:0:14508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620032.539890:0:14508:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620032.540117:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677007872 00000100:00100000:1.0:1788620032.540135:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677007872 00000100:00100000:1.0:1788620032.540179:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788620032.540189:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14508:x1875503677007872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620032.540525:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14508:x1875503677007872:12345-0@lo:502:llog_process_th.0 Request processed in 338us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.540534:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620032.540752:0:14508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:937205a0-294a-4965-a8b3-aa80c7ce7507:14508:1875503677007872:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788620032.540799:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788620032.541139:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788620032.541164:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788620032.541181:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.541193:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788620032.541974:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788620032.541977:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620032.541979:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620032.541980:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620032.541982:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620032.541983:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620032.541985:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620032.541986:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620032.541988:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620032.541990:0:14461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620032.541994:0:14461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788620032.542003:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620032.542005:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620032.542006:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620032.542007:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620032.542008:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620032.542010:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620032.542011:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620032.542013:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620032.542014:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620032.542015:0:14461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620032.542036:0:14461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788620032.542053:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677008000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788620032.542120:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.542164:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620032.542230:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008000 00000100:00100000:0.0:1788620032.542235:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008000 00000100:00100000:0.0:1788620032.542269:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620032.542278:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14461:x1875503677008000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620032.542301:0:14474:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788620032.542318:0:14474:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788620032.574421:0:14474:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788620032.574442:0:14474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788620032.574577:0:14495:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788620032.574583:0:14495:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788620032.574605:0:14495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.574624:0:14495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 12 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.574634:0:14495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.574675:0:14495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 12 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.574706:0:14495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 12 pid: 14473 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.574722:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677008128:0@lo:104: 00000100:00100000:2.0:1788620032.574821:0:14495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620032.575265:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc58d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620032.575620:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008128 00000100:00100000:1.0:1788620032.575633:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008128 00000100:00100000:1.0:1788620032.575683:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620032.575702:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677008128:12345-0@lo:104: 00010000:00010000:1.0:1788620032.575717:0:14462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575800:0:14462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620032.575808:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677008128:12345-0@lo:104: Request processed in 117us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.575815:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788620032.575850:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620032.575857:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575864:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620032.575868:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575877:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620032.575884:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620032.575890:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788620032.575918:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575925:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620032.575946:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575958:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf16f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620032.575972:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620032.575974:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620032.575976:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620032.576005:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677008256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620032.576036:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620032.576052:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677008128:0@lo:104: 00010000:00010000:3.0:1788620032.576075:0:14495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.577266:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008256 00000100:00100000:2.0:1788620032.577275:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008256 00010000:00010000:2.0:1788620032.577302:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 13 pid: 14473 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.577338:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620032.577348:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+13:3310:x1875503677008256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620032.577361:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620032.577367:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 13 pid: 14473 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577378:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 13 pid: 14473 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577394:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed6e00/0xbb0e330328bbf16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf168 expref: 13 pid: 14473 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577408:0:14464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577418:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620032.577437:0:14464:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002855071s 00010000:00010000:2.0:1788620032.577443:0:14464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577454:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577463:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577478:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577484:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620032.577488:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577496:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577512:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620032.577521:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620032.577541:0:14495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.577552:0:14495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620032.577559:0:14495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed6000/0xbb0e330328bbf1a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620032.577580:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3310:x1875503677008256:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620032.577587:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620032.577668:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677008256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620032.585628:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14461:x1875503677008000:12345-0@lo:253:mount.lustre.0 Request processed in 43344us (43502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620032.585640:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620032.585896:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:14461:1875503677008000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620032.585912:0:14461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788620032.585915:0:14461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620032.585916:0:14461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620032.585918:0:14461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620032.585919:0:14461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620032.585920:0:14461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620032.585921:0:14461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620032.585922:0:14461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620032.585924:0:14461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620032.585925:0:14461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620032.585926:0:14461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788620032.585940:0:14461:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788620032.590013:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.590154:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620032.590430:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.590592:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620032.590890:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.591051:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620032.591661:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.591832:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620032.592097:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.592324:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620032.592524:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620032.592649:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788620032.611021:0:14461:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788620032.611421:0:14461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788620032.611617:0:14519:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788620032.611621:0:14519:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788620032.612004:0:14520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788620032.612079:0:14520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620032.614505:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788620032.614573:0:14520:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788620032.614578:0:14520:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788620032.616208:0:14461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788620032.616332:0:14461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788620032.616908:0:14461:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788620032.616917:0:14461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788620032.617057:0:14461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620032.618388:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788620032.618973:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788620032.619003:0:14461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788620032.620280:0:14461:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788620032.624317:0:14461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788620032.655514:0:14461:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788620032.655548:0:14461:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc7c01c87988 00100000:10000000:1.0:1788620032.655581:0:14461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788620032.657604:0:14461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788620032.657620:0:14461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788620032.657637:0:14461:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788620032.657652:0:14461:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788620033.158947:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788620033.543638:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788620033.671141:0:14476:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788620033.671149:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933384eee800 from 6 10000000:01000000:1.0:1788620033.671155:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788620033.671202:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620033.671214:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620033.671225:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620033.671249:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677008384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620033.671317:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620033.671396:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333860ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620033.671527:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008384 00000100:00100000:0.0:1788620033.671535:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008384 00000100:00100000:0.0:1788620033.671587:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620033.671596:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14476:x1875503677008384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620033.671608:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620033.671624:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf1a7 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620033.671803:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620033.671815:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620033.671824:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2800, rc 0) 00000100:00100000:0.0:1788620033.671865:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677008384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620033.671871:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620033.672676:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677008384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620033.672703:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620033.672713:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620033.672792:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677008512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788620033.672835:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620033.672875:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333860ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620033.673079:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008512 00000100:00100000:0.0:1788620033.673084:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008512 00000100:00100000:0.0:1788620033.673121:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620033.673129:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677008512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788620033.673144:0:14474:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788620033.673159:0:14474:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788620033.673162:0:14474:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788620033.673434:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677008512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 305us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620033.673442:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620033.673518:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677008512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788620033.673556:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788620033.673564:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620033.673573:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620034.189466:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788620034.568448:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788620035.208428:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620036.231259:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788620037.202315:0:14762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788620037.254932:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620037.832409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788620037.832415:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788620037.832419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788620037.832423:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788620037.832425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788620037.832429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788620037.832433:0:37:0:(import.c:65:import_set_state_nolock()) ffff9333836dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788620037.832451:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9333836dc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788620037.832475:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333c1edb100 x1875503677008768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620037.832723:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677008640:0@lo:400:kworker.0 00000100:00100000:1.0:1788620037.832834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620037.832875:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008640 00000100:00100000:2.0:1788620037.832883:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008640 00000100:00100000:1.0:1788620037.832904:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677008768:0@lo:38:kworker.0 00000100:00100000:1.0:1788620037.832940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620037.833076:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008768 00000100:00100000:0.0:1788620037.833081:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008768 00000100:00100000:0.0:1788620037.833106:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620037.833113:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875503677008768:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788620037.833138:0:14481:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1788620037.833171:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb0e330328bbf1b5 00000004:00100000:0.0:1788620037.833298:0:14481:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788620037.833427:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9333a53c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620037.833498:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620037.833508:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3311:x1875503677008640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620037.833556:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875503677008768:12345-0@lo:38:kworker.0 Request processed in 441us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620037.833572:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620037.833627:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3311:x1875503677008640:12345-0@lo:400:kworker.0 Request processed in 121us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620037.833636:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620037.833701:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677008640:0@lo:400:kworker.0 00010000:00080000:1.0:1788620037.834699:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333c1edb100 x1875503677008768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620037.834711:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788620037.834715:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788620037.834719:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788620037.834720:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333836dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788620037.834725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677008768:0@lo:38:kworker.0 00010000:00010000:2.0:1788620038.281335:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620039.304166:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788620039.928721:0:14913:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68134ca0 20000000:00000080:3.0:1788620039.928740:0:14913:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933391725400 uarg=0000000000000000 20000000:01000000:3.0:1788620039.928855:0:14913:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788620039.928862:0:14913:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788620039.928867:0:14913:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788620039.941511:0:14914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788620039.950608:0:14913:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788620039.961972:0:14913:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788620039.962119:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620039.962140:0:14913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620039.962148:0:14913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620039.962240:0:14913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620039.962256:0:14913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 11 pid: 14474 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620039.962333:0:14913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14913:1875503677008896:0@lo:104: 00000100:00100000:2.0:1788620039.962403:0:14913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620039.962553:0:14913:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620039.966156:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677008896 00000100:00100000:0.0:1788620039.966178:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677008896 00000100:00100000:0.0:1788620039.966230:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620039.966239:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14913:x1875503677008896:12345-0@lo:104: 00010000:00010000:0.0:1788620039.966475:0:14462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620039.966579:0:14462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620039.966586:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14913:x1875503677008896:12345-0@lo:104: Request processed in 349us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620039.966592:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620039.966686:0:14913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14913:1875503677008896:0@lo:104: 00010000:00010000:2.0:1788620039.966711:0:14913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966763:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620039.966797:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966823:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620039.966828:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966835:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620039.966842:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620039.966847:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620039.966886:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966893:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620039.966918:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966925:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbf176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf17d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.966942:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620039.966944:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620039.966945:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620039.966999:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677009024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620039.967034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620039.967181:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009024 00000100:00100000:1.0:1788620039.967186:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009024 00010000:00010000:1.0:1788620039.967205:0:14465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 12 pid: 14474 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620039.967236:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620039.967250:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3312:x1875503677009024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620039.967271:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620039.967277:0:14465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 12 pid: 14474 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967288:0:14465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 12 pid: 14474 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967301:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf17d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf176 expref: 12 pid: 14474 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967315:0:14465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967323:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967337:0:14465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967344:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967349:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967356:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967361:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620039.967366:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967380:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967402:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620039.967414:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620039.967448:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+11:3312:x1875503677009024:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620039.967456:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620039.967482:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677009024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620039.967588:0:14913:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620039.967596:0:14913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620039.967602:0:14913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed7200/0xbb0e330328bbf1bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620040.327519:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620041.351964:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788620041.798861:0:14476:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620041.798867:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933384eee800 from 10 10000000:01000000:0.0:1788620041.798872:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620041.798914:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620041.798925:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620041.798936:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620041.798960:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620041.799032:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620041.799086:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788620041.799518:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009152 00000100:00100000:2.0:1788620041.799526:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009152 00000100:00100000:2.0:1788620041.799577:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788620041.799586:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+11:14476:x1875503677009152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620041.799598:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620041.799612:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf1c3 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620041.799646:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620041.799656:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620041.799664:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7800, rc 0) 00000100:00100000:2.0:1788620041.799716:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677009152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620041.799724:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788620041.799922:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620041.799938:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620041.799947:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620041.800000:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620041.800027:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620041.800055:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333926da900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620041.800106:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009280 00000100:00100000:2.0:1788620041.800110:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009280 00000100:00100000:2.0:1788620041.800191:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620041.800198:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677009280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620041.800646:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677009280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620041.800654:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620041.803359:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620041.803681:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620041.803752:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620041.803917:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009408 00000100:00100000:3.0:1788620041.803925:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009408 00000100:00100000:3.0:1788620041.803974:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788620041.803983:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677009408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620041.805913:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:14476:x1875503677009408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1924us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620041.805925:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788620041.806996:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf412840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620041.807026:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677009408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620041.822696:0:14975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788620041.823239:0:14476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788620041.823271:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620041.823283:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620041.823295:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620042.376030:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788620042.951932:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620042.951938:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620042.951941:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620042.951945:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620042.952116:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677009664:0@lo:400:kworker.0 00000100:00100000:0.0:1788620042.952176:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620042.952224:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620042.952230:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677009536:0@lo:400:kworker.0 00000100:00100000:0.0:1788620042.952415:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620042.952469:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009664 00000100:00100000:0.0:1788620042.952476:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009664 00000100:00100000:0.0:1788620042.952513:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620042.952522:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620042.952567:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677009664:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620042.952573:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620042.952595:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677009536 00000100:00100000:0.0:1788620042.952598:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677009536 00000100:00100000:0.0:1788620042.952635:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620042.952642:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3310:x1875503677009536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620042.952671:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+12:3310:x1875503677009536:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620042.952678:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788620042.952703:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677009536:0@lo:400:kworker.0 00010000:00080000:1.0:1788620042.952723:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333bc10d180 x1875503677009664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620042.952734:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677009664:0@lo:400:kworker.0 00000100:00100000:1.0:1788620042.953020:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620032/real 1788620032] req@ffff9333c1ed9c00 x1875503677006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620042.953038:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333c1ed9c00 x1875503677006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620042.953424:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620032/real 1788620032] req@ffff9333902c4700 x1875503677005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620042.953454:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333902c4700 x1875503677005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620042.953467:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620042.953481:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620042.953485:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677006080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788620042.953489:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620042.953494:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620042.953497:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677005952:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788620042.954595:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620042.954603:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788620042.954606:0:13043:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788620042.954613:0:13043:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788620042.954631:0:13043:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788620042.954638:0:13043:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333a53c0000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620042.954670:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bc10f480 x1875503677009792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620042.954686:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620042.954689:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788620042.954691:0:13043:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788620042.954694:0:13043:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788620042.954696:0:13043:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788620042.954699:0:13043:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385805800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620042.954710:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bc10c380 x1875503677009920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620042.956709:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677009792:0@lo:8:kworker.0 00000400:00000100:3.0:1788620042.956807:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677009792 offset 0 length 520: 4 00000100:00100000:3.0:1788620042.956843:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677009920:0@lo:8:kworker.0 00000400:00000100:3.0:1788620042.956860:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677009920 offset 0 length 520: 4 00010000:00010000:1.0:1788620043.400030:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620044.422988:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620044.807367:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788620044.988698:0:15161:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788620044.988861:0:15161:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788620044.988971:0:15161:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933387e54000 00000020:01000004:2.0:1788620044.988986:0:15161:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788620044.988996:0:15161:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788620044.989009:0:15161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9332849cb380) 00000020:00000080:2.0:1788620044.989025:0:15161:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788620045.020146:0:15161:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788620045.020688:0:15161:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788620045.022676:0:15161:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788620045.022949:0:15161:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788620045.023138:0:15161:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788620045.024939:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788620045.025133:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788620045.025231:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788620045.025715:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1788620045.026125:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788620045.026373:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1788620045.026646:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788620045.026934:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1788620045.027205:0:15161:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00000020:00000080:3.0:1788620045.027753:0:15161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788620045.027765:0:15161:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788620045.027800:0:15161:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbf1d8 00000020:01000004:3.0:1788620045.027808:0:15161:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788620045.027830:0:15161:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788620045.027833:0:15161:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788620045.027839:0:15161:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788620045.027844:0:15161:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788620045.027854:0:15161:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9333bd340000) 00000020:00000080:3.0:1788620045.027863:0:15161:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788620045.032847:0:15161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620045.033047:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788620045.033054:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788620045.036121:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788620045.036132:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788620045.036411:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788620045.036418:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788620045.045316:0:15161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620045.046087:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620045.046095:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788620045.049336:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788620045.049349:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788620045.073336:0:15161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620045.073991:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788620045.073998:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788620045.075717:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788620045.075728:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788620045.080562:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788620045.080574:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788620045.082715:0:15161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620045.085645:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620045.085655:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788620045.086939:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788620045.086960:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788620045.148934:0:15161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620045.152216:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788620045.152226:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788620045.153366:0:15161:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788620045.153382:0:15161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788620045.156720:0:15161:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788620045.156747:0:15161:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788620045.156753:0:15161:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788620045.169411:0:15161:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788620045.169458:0:15161:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788620045.169463:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788620045.169466:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788620045.169467:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620045.169468:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620045.169469:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620045.169470:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620045.169472:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620045.169474:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620045.169475:0:15161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620045.169478:0:15161:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788620045.169481:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620045.169482:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788620045.169484:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620045.169489:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620045.169490:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620045.169491:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620045.169492:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620045.169492:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620045.169493:0:15161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620045.169684:0:15161:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788620045.169705:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788620045.169797:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620045.169980:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620045.170123:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010048 00000100:00100000:2.0:1788620045.170133:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010048 00000100:00100000:2.0:1788620045.170449:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620045.170462:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:15161:x1875503677010048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788620045.170494:0:14474:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788620045.170498:0:14474:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788620045.170502:0:14474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788620045.177051:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:15161:x1875503677010048:12345-0@lo:253:mount.lustre.0 Request processed in 6582us (7242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.177066:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620045.177208:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620045.177224:0:15161:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620045.177228:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620045.177230:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620045.177231:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620045.177232:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620045.177233:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620045.177234:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620045.177236:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620045.177238:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620045.177239:0:15161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620045.177258:0:15161:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933387e54000 from lustre-OST0000 10000000:01000000:2.0:1788620045.177284:0:15161:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788620045.177286:0:15161:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788620045.177293:0:15161:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9333bd1d4d40 local copy 00010000:00010000:2.0:1788620045.177302:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620045.177543:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620045.177676:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.177790:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620045.178434:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010176 00000100:00100000:0.0:1788620045.178442:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010176 00000100:00100000:0.0:1788620045.178497:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620045.178507:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+12:15161:x1875503677010176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.178981:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+12:15161:x1875503677010176:12345-0@lo:501:mount.lustre.0 Request processed in 474us (1303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620045.178989:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788620045.179322:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010176:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788620045.179344:0:15161:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788620045.179524:0:15161:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788620045.179533:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.179629:0:15161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620045.179657:0:15161:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933387e54000 10000000:01000000:2.0:1788620045.179662:0:15161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620045.179667:0:15161:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9333bd1d4d40 10000000:01000000:2.0:1788620045.179669:0:15161:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788620045.179673:0:15161:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9333bd1d4d40 from 1 10000000:01000000:2.0:1788620045.179675:0:15161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788620045.179707:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.179715:0:15161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.179725:0:15161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620045.179743:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620045.180112:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.180320:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620045.180366:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010304 00000100:00100000:3.0:1788620045.180374:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010304 00000100:00100000:3.0:1788620045.180454:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620045.180463:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+12:15161:x1875503677010304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620045.180474:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620045.180488:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf1ed lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf1e6 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.180510:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf1ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf1e6 expref: 13 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.180520:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf1ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1e6 expref: 13 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.180529:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0000, rc 0) 00000100:00100000:3.0:1788620045.180589:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+13:15161:x1875503677010304:12345-0@lo:101:mount.lustre.0 Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.180595:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620045.180694:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620045.180713:0:15161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.180721:0:15161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620045.180738:0:15161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788620045.180758:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.180765:0:15161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620045.180788:0:15161:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788620045.180793:0:15161:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620045.180798:0:15161:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788620045.180800:0:15161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788620045.180819:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.180826:0:15161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.180834:0:15161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620045.180857:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620045.180888:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.181248:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620045.181381:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010432 00000100:00100000:2.0:1788620045.181387:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010432 00000100:00100000:2.0:1788620045.181455:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788620045.181462:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+13:15161:x1875503677010432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620045.181471:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620045.181488:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed7c00/0xbb0e330328bbf1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf1f4 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.181505:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed7c00/0xbb0e330328bbf1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf1f4 expref: 14 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.181515:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed7c00/0xbb0e330328bbf1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1f4 expref: 14 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.181523:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7c00, rc 0) 00000100:00100000:2.0:1788620045.181572:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010432:12345-0@lo:101:mount.lustre.0 Request processed in 110us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620045.181578:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788620045.181715:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620045.181729:0:15161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.181738:0:15161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620045.182535:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788620045.184637:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620045.184940:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788620045.185275:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788620045.185306:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788620045.185352:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788620045.185384:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788620045.185411:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788620045.185465:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788620045.185472:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788620045.185627:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.185695:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.185738:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620045.185813:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010560 00000100:00100000:3.0:1788620045.185822:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010560 00000100:00100000:3.0:1788620045.185864:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788620045.185873:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620045.186202:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010560:12345-0@lo:501:mount.lustre.0 Request processed in 330us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.186208:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788620045.186448:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.186477:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620045.186507:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.186531:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620045.186623:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010688 00000100:00100000:3.0:1788620045.186628:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010688 00000100:00100000:3.0:1788620045.186701:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620045.186709:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620045.187291:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010688:12345-0@lo:503:mount.lustre.0 Request processed in 580us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.187298:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788620045.187431:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010688:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620045.188021:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620045.188090:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620045.188343:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.188740:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620045.188800:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010816 00000100:00100000:2.0:1788620045.188808:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010816 00000100:00100000:2.0:1788620045.188842:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788620045.188850:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620045.189088:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010816:12345-0@lo:502:mount.lustre.0 Request processed in 238us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620045.189096:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788620045.189298:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620045.189555:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788620045.189620:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788620045.189656:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788620045.189724:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788620045.189767:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788620045.189839:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788620045.189890:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788620045.189929:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788620045.189980:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788620045.190033:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788620045.190071:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788620045.190132:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788620045.190288:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620045.190334:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.190366:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387fcb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620045.190530:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677010944 00000100:00100000:2.0:1788620045.190537:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677010944 00000100:00100000:2.0:1788620045.190576:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788620045.190583:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620045.190758:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677010944:12345-0@lo:502:mount.lustre.0 Request processed in 174us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620045.190766:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788620045.191019:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677010944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620045.191095:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788620045.191105:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788620045.192427:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788620045.192436:0:15176:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788620045.192443:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620045.192445:0:15176:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788620045.192450:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788620045.192477:0:15176:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9332843b99c0) 00000020:00000080:0.0:1788620045.192499:0:15176:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788620045.192507:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788620045.192739:0:15176:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933387e54000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788620045.192748:0:15176:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788620045.192755:0:15176:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbf209 00010000:00010000:0.0:1788620045.198919:0:15176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788620045.199458:0:15176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788620045.202867:0:15176:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788620045.204768:0:15176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788620045.204808:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.204815:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204817:0:15176:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788620045.204821:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788620045.204823:0:15176:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788620045.204825:0:15176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620045.204827:0:15176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620045.204829:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788620045.204831:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204833:0:15176:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788620045.204836:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620045.204839:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204841:0:15176:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620045.204844:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620045.204847:0:15176:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788620045.204849:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.204857:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204859:0:15176:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788620045.204862:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620045.204865:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204867:0:15176:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620045.204870:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788620045.204931:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.204935:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.204937:0:15176:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620045.204940:0:15176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788620045.207979:0:15161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788620045.208023:0:15161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788620045.208047:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.208061:0:15161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620045.208069:0:15161:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933387e54000 from 1 10000000:01000000:2.0:1788620045.208072:0:15161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620045.208111:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.208120:0:15161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.208130:0:15161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620045.208316:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620045.208386:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.208435:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338f96f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788620045.208619:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011072 00000100:00100000:3.0:1788620045.208627:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011072 00000100:00100000:3.0:1788620045.208675:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788620045.208684:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+14:15161:x1875503677011072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620045.208698:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620045.208710:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf210 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.208733:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 15 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.208743:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 15 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620045.208752:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1200, rc 0) 00000100:00100000:3.0:1788620045.208820:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011072:12345-0@lo:101:mount.lustre.0 Request processed in 136us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.208826:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788620045.208970:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620045.208985:0:15161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.208993:0:15161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620045.209530:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788620045.210264:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620045.210524:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788620045.210568:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788620045.210645:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788620045.210654:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788620045.210718:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620045.210767:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.210825:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338f96f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.212932:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011200 00000100:00100000:1.0:1788620045.212953:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011200 00000100:00100000:1.0:1788620045.213009:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788620045.213019:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620045.213478:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011200:12345-0@lo:501:mount.lustre.0 Request processed in 459us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.213486:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788620045.213677:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620045.213732:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620045.213812:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620045.213842:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620045.213908:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011328 00000100:00100000:0.0:1788620045.213913:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011328 00000100:00100000:0.0:1788620045.213953:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788620045.213960:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620045.214105:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011328:12345-0@lo:503:mount.lustre.0 Request processed in 144us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620045.214111:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788620045.214299:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620045.214909:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620045.214985:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620045.215028:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620045.215050:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620045.216665:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011456 00000100:00100000:0.0:1788620045.216676:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011456 00000100:00100000:0.0:1788620045.216723:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788620045.216733:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620045.216984:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011456:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620045.216992:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788620045.217449:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620045.217751:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788620045.217832:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788620045.217884:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788620045.217921:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788620045.217969:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788620045.218021:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788620045.218056:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788620045.218085:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788620045.218119:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620045.218290:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620045.218318:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.218384:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011584 00000100:00100000:1.0:1788620045.218391:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011584 00000100:00100000:1.0:1788620045.218422:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788620045.218428:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620045.218619:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011584:12345-0@lo:502:mount.lustre.0 Request processed in 189us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.218636:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620045.219098:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620045.219896:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788620045.219912:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788620045.221037:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620045.221047:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.221049:0:15180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788620045.221055:0:15180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933387e54000 00000020:00000080:3.0:1788620045.221057:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620045.221070:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.221072:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.221073:0:15180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788620045.221076:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620045.221078:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.221079:0:15180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788620045.221082:0:15180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933387e54000 00000020:00000080:3.0:1788620045.221084:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620045.222295:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.222306:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.222308:0:15180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788620045.222312:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620045.222315:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.222316:0:15180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788620045.222320:0:15180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933387e54000 00000020:00000080:3.0:1788620045.222323:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620045.223093:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620045.223099:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620045.223101:0:15180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788620045.223104:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788620045.223561:0:15161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788620045.223589:0:15161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620045.223620:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.223632:0:15161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620045.223674:0:15161:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788620045.223677:0:15161:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933387e54000 10000000:01000000:2.0:1788620045.223680:0:15161:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933387e54000 10000000:01000000:2.0:1788620045.223684:0:15161:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620045.223689:0:15161:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933387e54000 from 1 10000000:01000000:2.0:1788620045.223692:0:15161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788620045.223729:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.223738:0:15161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.223750:0:15161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620045.223815:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620045.223879:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.223918:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338f96f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.224873:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011712 00000100:00100000:1.0:1788620045.224882:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011712 00000100:00100000:1.0:1788620045.224935:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788620045.225045:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677011712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620045.225060:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620045.225074:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbf225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf21e expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.225099:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbf225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf21e expref: 16 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.225111:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbf225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf21e expref: 16 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.225121:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143c00, rc 0) 00000100:00100000:1.0:1788620045.225248:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677011712:12345-0@lo:101:mount.lustre.0 Request processed in 304us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.225255:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788620045.225345:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620045.225361:0:15161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620045.225371:0:15161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620045.226262:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788620045.226551:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620045.226881:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788620045.226929:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788620045.231937:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788620045.232071:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788620045.232130:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788620045.232219:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788620045.232261:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788620045.232299:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788620045.232369:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788620045.232414:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788620045.232462:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788620045.232525:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788620045.232593:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788620045.232661:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788620045.232753:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788620045.232816:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788620045.232853:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788620045.232902:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788620045.232938:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788620045.232974:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788620045.233025:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788620045.233066:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788620045.233102:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788620045.233152:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788620045.233206:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788620045.233261:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788620045.233341:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788620045.233404:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788620045.233526:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788620045.233537:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788620045.233658:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.233723:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.233793:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011840 00000100:00100000:0.0:1788620045.233801:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011840 00000100:00100000:0.0:1788620045.233850:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620045.233859:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677011840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.234091:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677011840:12345-0@lo:501:mount.lustre.0 Request processed in 232us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620045.234099:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620045.234151:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382e7d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620045.234175:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620045.234227:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620045.234267:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.234281:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382e7d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.234813:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677011968 00000100:00100000:1.0:1788620045.234820:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677011968 00000100:00100000:1.0:1788620045.234856:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788620045.234865:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677011968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620045.235051:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677011968:12345-0@lo:503:mount.lustre.0 Request processed in 186us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.235058:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788620045.235306:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677011968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620045.236517:0:15161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620045.236600:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620045.236673:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.236718:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.236805:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012096 00000100:00100000:1.0:1788620045.236819:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012096 00000100:00100000:1.0:1788620045.236853:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620045.236860:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677012096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620045.237079:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677012096:12345-0@lo:502:mount.lustre.0 Request processed in 218us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.237087:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788620045.237183:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620045.237410:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788620045.237456:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788620045.237496:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788620045.237548:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788620045.237588:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788620045.237662:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788620045.237706:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788620045.237744:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788620045.237833:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788620045.237874:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788620045.237913:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788620045.237964:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788620045.238022:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788620045.238060:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788620045.238128:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788620045.238169:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788620045.238208:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788620045.238261:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788620045.238300:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788620045.238350:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788620045.238405:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788620045.238448:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788620045.238490:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788620045.238567:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788620045.238621:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788620045.238660:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788620045.238713:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788620045.238748:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788620045.238821:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788620045.238877:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788620045.238920:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788620045.238959:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788620045.239001:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788620045.239068:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788620045.239123:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788620045.239185:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788620045.239226:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788620045.239264:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788620045.239314:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788620045.239346:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788620045.239394:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620045.239462:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.240252:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382e7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620045.240317:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012224 00000100:00100000:3.0:1788620045.240325:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012224 00000100:00100000:3.0:1788620045.240409:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788620045.240419:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677012224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620045.240665:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677012224:12345-0@lo:502:mount.lustre.0 Request processed in 247us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.240673:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788620045.240759:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620045.240868:0:15161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788620045.240881:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788620045.241977:0:15184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788620045.242005:0:15184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93328485cd40) 00000020:00000080:1.0:1788620045.242027:0:15184:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788620045.242260:0:15184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933387e54000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788620045.242265:0:15184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933387e54000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788620045.242268:0:15184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933387e54000 3 00010000:00080000:1.0:1788620045.242307:0:15184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333bbd70000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788620045.244555:0:15184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788620045.244903:0:15184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788620045.245013:0:15184:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788620045.245028:0:15184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb0e330328bbf233 00000100:00080000:1.0:1788620045.245038:0:15184:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788620045.245045:0:15184:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333bbd70000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620045.245081:0:15184:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933285999500 x1875503677012352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788620045.245110:0:15184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788620045.245211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677012352:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788620045.245311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620045.245317:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620045.245319:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620045.245330:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788620045.245384:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677012480:0@lo:400:kworker.0 00000100:00100000:3.0:1788620045.245446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620045.245495:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012480 00000100:00100000:3.0:1788620045.245501:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012480 00000100:00100000:3.0:1788620045.245541:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620045.245549:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620045.245623:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677012480:12345-0@lo:400:kworker.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620045.245631:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788620045.245670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333902c4a80 x1875503677012480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620045.245684:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677012480:0@lo:400:kworker.0 00000100:00100000:2.0:1788620045.246544:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620045.246647:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012352 00000100:00100000:2.0:1788620045.246654:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012352 00000100:00100000:2.0:1788620045.246688:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620045.246694:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875503677012352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788620045.246717:0:14481:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1788620045.246766:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb0e330328bbf23a 00000004:00100000:2.0:1788620045.246800:0:14481:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788620045.246836:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9332849a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620045.246883:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875503677012352:12345-0@lo:38:llog_process_th.0 Request processed in 188us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620045.246901:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788620045.246951:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff933285999500 x1875503677012352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620045.246960:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788620045.246967:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788620045.246974:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788620045.246978:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788620045.246981:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bbd70000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788620045.246986:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677012352:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788620045.247456:0:15184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788620045.250673:0:15161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788620045.250716:0:15161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788620045.250744:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.250769:0:15161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788620045.250827:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788620045.250829:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788620045.250831:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620045.250832:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620045.250833:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620045.250835:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620045.250836:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788620045.250838:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620045.250839:0:15161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788620045.250843:0:15161:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788620045.250845:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788620045.250846:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788620045.250847:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620045.250848:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620045.250849:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620045.250850:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620045.250851:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788620045.250852:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620045.250853:0:15161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788620045.250876:0:15161:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788620045.250893:0:15161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788620045.252236:0:15161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620045.252289:0:15161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333981816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620045.253057:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012608 00000100:00100000:0.0:1788620045.253067:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012608 00000100:00100000:0.0:1788620045.253112:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788620045.253121:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15161:x1875503677012608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620045.253218:0:14474:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788620045.253232:0:14474:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788620045.306846:0:14474:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788620045.306868:0:14474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788620045.307295:0:14495:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788620045.307300:0:14495:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788620045.307321:0:14495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.307340:0:14495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 16 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.307349:0:14495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.307387:0:14495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 16 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620045.307402:0:14495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 16 pid: 14472 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620045.307415:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677012736:0@lo:104: 00000100:00100000:0.0:1788620045.307476:0:14495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620045.307528:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620045.307649:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012736 00000100:00100000:1.0:1788620045.307659:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012736 00000100:00100000:1.0:1788620045.307700:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620045.307707:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677012736:12345-0@lo:104: 00010000:00010000:1.0:1788620045.307720:0:14463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307797:0:14463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620045.307803:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677012736:12345-0@lo:104: Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.307810:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788620045.307830:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620045.307835:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307841:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143e00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620045.307845:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307852:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620045.307859:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620045.307864:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788620045.307888:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307893:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620045.307908:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307915:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ae expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.307950:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620045.307952:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620045.307954:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620045.307971:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677012864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620045.307997:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620045.308033:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012864 00000100:00100000:1.0:1788620045.308036:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012864 00010000:00010000:1.0:1788620045.308050:0:14466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 17 pid: 14472 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620045.308067:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620045.308072:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:3312:x1875503677012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620045.308080:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620045.308084:0:14466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 17 pid: 14472 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308093:0:14466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 17 pid: 14472 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308107:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308115:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788620045.308125:0:14466:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002855071s 00010000:00010000:1.0:1788620045.308128:0:14466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308156:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308163:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308167:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308171:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620045.308174:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308179:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308184:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308190:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620045.308211:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:3312:x1875503677012864:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.308215:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620045.308240:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677012864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620045.308256:0:14495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2800/0xbb0e330328bbf1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf1a7 expref: 16 pid: 14472 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620045.308262:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677012736:0@lo:104: 00010000:00010000:1.0:1788620045.308270:0:14495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308281:0:14495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308285:0:14495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620045.308289:0:14495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c3e00/0xbb0e330328bbf241 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620045.316830:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+15:15161:x1875503677012608:12345-0@lo:253:mount.lustre.0 Request processed in 63642us (64530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620045.316845:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788620045.316940:0:15161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15161:1875503677012608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788620045.317023:0:15161:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788620045.317026:0:15161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788620045.317029:0:15161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788620045.317030:0:15161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620045.317031:0:15161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620045.317032:0:15161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620045.317034:0:15161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620045.317035:0:15161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620045.317052:0:15161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620045.317053:0:15161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788620045.317075:0:15161:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788620045.324249:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620045.324434:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620045.324597:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620045.324768:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620045.324960:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620045.325382:0:15161:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788620045.328243:0:15161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788620045.366256:0:15161:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788620045.366264:0:15161:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788620045.366299:0:15161:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788620045.366353:0:15161:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788620045.366364:0:15161:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788620045.366391:0:15161:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788620045.450223:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620046.471068:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788620047.304197:0:14476:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788620047.304204:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933384eee800 from 7 10000000:01000000:2.0:1788620047.304278:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620047.304321:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620047.304333:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620047.304345:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620047.304381:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677012992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620047.304443:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620047.304544:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788620047.304595:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677012992 00000100:00100000:3.0:1788620047.304602:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677012992 00000100:00100000:3.0:1788620047.304698:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788620047.304709:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+15:14476:x1875503677012992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620047.304721:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620047.304734:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf248 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620047.304809:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 16 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620047.304821:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 16 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620047.304830:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:3.0:1788620047.304872:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+16:14476:x1875503677012992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620047.304879:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788620047.304962:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677012992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620047.304979:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620047.304988:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620047.305031:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677013120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788620047.305059:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620047.309290:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788620047.309353:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013120 00000100:00100000:0.0:1788620047.309363:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013120 00000100:00100000:1.0:1788620047.312553:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620047.312566:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:14476:x1875503677013120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788620047.312601:0:14473:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788620047.312618:0:14473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788620047.312622:0:14473:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788620047.312980:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:14476:x1875503677013120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 415us (7918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620047.312989:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620047.313041:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677013120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788620047.313284:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788620047.313296:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620047.313328:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620047.496698:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620048.522473:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620049.547482:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620050.566919:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788620050.631944:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620050.631950:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620050.631953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620050.631956:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620050.632013:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677013504:0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620050.632278:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677013376:0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632304:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620050.632324:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620050.632330:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677013248:0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632357:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620050.632390:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013504 00000100:00100000:0.0:1788620050.632397:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013504 00000100:00100000:0.0:1788620050.632444:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013376 00000100:00100000:0.0:1788620050.632447:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013376 00000100:00100000:0.0:1788620050.632461:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620050.632468:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677013504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632518:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677013504:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620050.632525:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620050.632553:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620050.632559:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677013376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632604:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677013376:12345-0@lo:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620050.632609:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788620050.632651:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10e680 x1875503677013376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620050.632663:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677013376:0@lo:400:kworker.0 00010000:00080000:0.0:1788620050.632688:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10d500 x1875503677013504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620050.632696:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677013504:0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632731:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013248 00000100:00100000:0.0:1788620050.632737:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013248 00000100:00100000:0.0:1788620050.632762:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788620050.632767:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:3310:x1875503677013248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620050.632842:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:3310:x1875503677013248:12345-0@lo:400:kworker.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620050.632848:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788620050.632880:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677013248:0@lo:400:kworker.0 00000100:00080000:3.0:1788620050.634548:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788620051.042935:0:15528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788620051.592611:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620052.616546:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620053.639196:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620054.023635:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788620054.665149:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620055.686907:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788620055.750896:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788620055.750908:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788620055.750913:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620055.750915:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620055.750918:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788620055.750929:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677013632:0@lo:400:kworker.0 00000100:00100000:0.0:1788620055.750967:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677013888:0@lo:400:kworker.0 00000100:00100000:3.0:1788620055.751070:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677013760:0@lo:400:kworker.0 00000100:00100000:0.0:1788620055.751278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620055.751335:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013888 00000100:00100000:0.0:1788620055.751341:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013888 00000100:00100000:0.0:1788620055.751390:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620055.751399:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677013888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620055.751448:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677013888:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620055.751455:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788620055.751507:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10e680 x1875503677013888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620055.751520:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677013888:0@lo:400:kworker.0 00000100:00100000:3.0:1788620055.752495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620055.752560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788620055.752922:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620055.752937:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013632 00000100:00100000:3.0:1788620055.752944:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013632 00000100:00100000:3.0:1788620055.752979:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620055.752986:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+16:3311:x1875503677013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620055.753028:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+16:3311:x1875503677013632:12345-0@lo:400:kworker.0 Request processed in 43us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620055.753035:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788620055.753702:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677013632:0@lo:400:kworker.0 00000100:00100000:0.0:1788620055.755011:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677013760 00000100:00100000:0.0:1788620055.755021:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677013760 00000100:00100000:0.0:1788620055.755169:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620055.755180:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677013760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620055.755357:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677013760:12345-0@lo:400:kworker.0 Request processed in 179us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620055.755365:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788620055.755422:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10d500 x1875503677013760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620055.755436:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677013760:0@lo:400:kworker.0 00010000:00010000:0.0:1788620056.710979:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788620057.364147:0:15877:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788620057.364162:0:15877:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788620057.364301:0:15877:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933390dfb000 00000020:01000004:3.0:1788620057.364317:0:15877:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788620057.364330:0:15877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788620057.364354:0:15877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9332870a19c0) 00000020:00000080:3.0:1788620057.364371:0:15877:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788620057.379515:0:15877:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788620057.379817:0:15877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788620057.380726:0:15877:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788620057.381140:0:15877:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788620057.381373:0:15877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788620057.381800:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 463: rc = 0 00100000:10000000:3.0:1788620057.381899:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 463: rc = 0 00100000:10000000:3.0:1788620057.381990:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 463: rc = 0 00100000:10000000:3.0:1788620057.382863:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00100000:10000000:3.0:1788620057.383189:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1788620057.383421:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:3.0:1788620057.383675:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:3.0:1788620057.383954:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1788620057.384556:0:15877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00000020:00000080:3.0:1788620057.385404:0:15877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788620057.385416:0:15877:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788620057.385427:0:15877:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbf25d 00000020:01000004:3.0:1788620057.385434:0:15877:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788620057.385458:0:15877:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788620057.385461:0:15877:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788620057.385467:0:15877:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788620057.385489:0:15877:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788620057.385493:0:15877:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788620057.393836:0:15877:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788620057.393872:0:15877:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788620057.393877:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788620057.393879:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620057.393880:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620057.393882:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620057.393883:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620057.393884:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620057.393886:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620057.393887:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620057.393889:0:15877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620057.393892:0:15877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788620057.393894:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620057.393896:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620057.393897:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620057.393898:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620057.393899:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620057.393900:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620057.393901:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620057.393902:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620057.393903:0:15877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620057.393929:0:15877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788620057.393950:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788620057.394022:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.394205:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.394294:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014016 00000100:00100000:0.0:1788620057.394303:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014016 00000100:00100000:0.0:1788620057.394391:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788620057.394400:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15877:x1875503677014016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620057.394429:0:14473:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788620057.394432:0:14473:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788620057.394436:0:14473:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788620057.399226:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15877:x1875503677014016:12345-0@lo:253:mount.lustre.0 Request processed in 4817us (5193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.399241:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788620057.399329:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788620057.399345:0:15877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788620057.399348:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788620057.399350:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620057.399351:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620057.399353:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620057.399354:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620057.399355:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620057.399356:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620057.399357:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620057.399359:0:15877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788620057.399393:0:15877:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933390dfb000 from lustre-OST0001 10000000:01000000:3.0:1788620057.399419:0:15877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788620057.399422:0:15877:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788620057.399429:0:15877:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9333bd1d4d40 local copy 00010000:00010000:3.0:1788620057.399438:0:15877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620057.399686:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620057.399723:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.399919:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.399987:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014144 00000100:00100000:0.0:1788620057.399995:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014144 00000100:00100000:0.0:1788620057.400077:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788620057.400087:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15877:x1875503677014144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620057.400263:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15877:x1875503677014144:12345-0@lo:501:mount.lustre.0 Request processed in 178us (539us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620057.400271:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620057.400331:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014144:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788620057.400346:0:15877:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788620057.400498:0:15877:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788620057.400506:0:15877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.400516:0:15877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620057.400552:0:15877:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933390dfb000 10000000:01000000:2.0:1788620057.400557:0:15877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620057.400562:0:15877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788620057.400572:0:15877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620057.400577:0:15877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788620057.400580:0:15877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788620057.400602:0:15877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.400610:0:15877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.400620:0:15877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620057.400634:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620057.400665:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.400935:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620057.400981:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014272 00000100:00100000:3.0:1788620057.400986:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014272 00000100:00100000:0.0:1788620057.401034:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788620057.401042:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:15877:x1875503677014272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620057.401134:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620057.401148:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2200/0xbb0e330328bbf26b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf264 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.401170:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2200/0xbb0e330328bbf26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf264 expref: 17 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.401181:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2200/0xbb0e330328bbf26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf264 expref: 17 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.401191:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2200, rc 0) 00000100:00100000:0.0:1788620057.401242:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014272:12345-0@lo:101:mount.lustre.0 Request processed in 201us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.401249:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788620057.401371:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620057.401389:0:15877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.401398:0:15877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620057.401996:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788620057.403379:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620057.403685:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788620057.403733:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788620057.403809:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788620057.403867:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788620057.403906:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788620057.403942:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788620057.404021:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788620057.404030:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788620057.404110:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620057.404170:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.404202:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.404340:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014400 00000100:00100000:1.0:1788620057.404348:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014400 00000100:00100000:1.0:1788620057.404396:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620057.404406:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620057.404832:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014400:12345-0@lo:501:mount.lustre.0 Request processed in 427us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.404841:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788620057.405137:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620057.405175:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620057.405216:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.405295:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620057.405426:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014528 00000100:00100000:3.0:1788620057.405431:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014528 00000100:00100000:3.0:1788620057.405456:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788620057.405462:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620057.405797:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014528:12345-0@lo:503:mount.lustre.0 Request processed in 333us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620057.405805:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788620057.405963:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014528:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788620057.406429:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788620057.406491:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620057.406554:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.406578:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.406757:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014656 00000100:00100000:0.0:1788620057.406764:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014656 00000100:00100000:0.0:1788620057.406821:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788620057.406828:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620057.407014:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014656:12345-0@lo:502:mount.lustre.0 Request processed in 185us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.407021:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788620057.407233:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620057.407475:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788620057.407545:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788620057.407581:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788620057.407627:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788620057.407666:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788620057.407716:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788620057.407764:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788620057.407821:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788620057.407867:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788620057.407899:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620057.407944:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.407975:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933382f9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.408148:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014784 00000100:00100000:0.0:1788620057.408154:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014784 00000100:00100000:0.0:1788620057.408195:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788620057.408202:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620057.408363:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014784:12345-0@lo:502:mount.lustre.0 Request processed in 161us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.408371:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788620057.408674:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620057.408748:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788620057.408759:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788620057.410852:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788620057.410862:0:15878:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788620057.410869:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.410871:0:15878:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788620057.410880:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788620057.410894:0:15878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9332843b8000) 00000020:00000080:0.0:1788620057.410915:0:15878:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788620057.410921:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788620057.411473:0:15878:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933390dfb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788620057.411481:0:15878:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788620057.411489:0:15878:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbf279 00010000:00010000:0.0:1788620057.416036:0:15878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788620057.416585:0:15878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788620057.419354:0:15878:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788620057.421639:0:15878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788620057.421663:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620057.421669:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.421671:0:15878:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788620057.421675:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620057.421678:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.421679:0:15878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788620057.421682:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788620057.421685:0:15878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788620057.421687:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620057.421689:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.421690:0:15878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788620057.421692:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620057.421695:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.421696:0:15878:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788620057.421699:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788620057.421763:0:15878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620057.421767:0:15878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620057.423118:0:15878:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788620057.423129:0:15878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788620057.423334:0:15877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788620057.423363:0:15877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788620057.423379:0:15877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.423390:0:15877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620057.423398:0:15877:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933390dfb000 from 1 10000000:01000000:3.0:1788620057.423401:0:15877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620057.423457:0:15877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.423464:0:15877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.423473:0:15877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620057.423497:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788620057.423578:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.423622:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.423735:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677014912 00000100:00100000:0.0:1788620057.423744:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677014912 00000100:00100000:0.0:1788620057.423812:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788620057.423821:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:15877:x1875503677014912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620057.423834:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620057.423847:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf280 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.423871:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.423881:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.423904:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:0.0:1788620057.423957:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677014912:12345-0@lo:101:mount.lustre.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.423964:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788620057.424211:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677014912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620057.424225:0:15877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.424233:0:15877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620057.424846:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788620057.425438:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620057.426683:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788620057.426752:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788620057.426849:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788620057.426858:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788620057.428681:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620057.428751:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.429159:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.434599:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015040 00000100:00100000:1.0:1788620057.434614:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015040 00000100:00100000:1.0:1788620057.434669:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620057.434679:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620057.435003:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015040:12345-0@lo:501:mount.lustre.0 Request processed in 324us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.435018:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788620057.435238:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620057.435307:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620057.435356:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.435393:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.435662:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015168 00000100:00100000:1.0:1788620057.435668:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015168 00000100:00100000:1.0:1788620057.435706:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620057.435713:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620057.436043:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015168:12345-0@lo:503:mount.lustre.0 Request processed in 329us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.436167:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620057.436217:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788620057.437240:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788620057.437318:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620057.437375:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620057.437401:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.437424:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015296 00000100:00100000:1.0:1788620057.437430:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015296 00000100:00100000:1.0:1788620057.437457:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620057.437464:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620057.437839:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015296:12345-0@lo:502:mount.lustre.0 Request processed in 374us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.437847:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788620057.438104:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620057.438354:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788620057.438406:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788620057.438458:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788620057.438496:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788620057.438557:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788620057.438609:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788620057.438674:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788620057.438712:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788620057.438745:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620057.438825:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620057.438852:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.439391:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015424 00000100:00100000:1.0:1788620057.439398:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015424 00000100:00100000:1.0:1788620057.439446:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788620057.439455:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620057.439839:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015424:12345-0@lo:502:mount.lustre.0 Request processed in 383us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.439854:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620057.448223:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620057.448419:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788620057.448433:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788620057.449475:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620057.449486:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449488:0:15882:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788620057.449495:0:15882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933390dfb000 00000020:00000080:2.0:1788620057.449498:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620057.449515:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620057.449527:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449528:0:15882:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788620057.449530:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620057.449532:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449534:0:15882:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788620057.449536:0:15882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933390dfb000 00000020:00000080:2.0:1788620057.449538:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620057.449600:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620057.449604:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449605:0:15882:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788620057.449608:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620057.449610:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449611:0:15882:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788620057.449614:0:15882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933390dfb000 00000020:00000080:2.0:1788620057.449616:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620057.449651:0:15882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620057.449654:0:15882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620057.449656:0:15882:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788620057.449659:0:15882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788620057.451627:0:15877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788620057.451667:0:15877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620057.451690:0:15877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.451702:0:15877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620057.451752:0:15877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788620057.451755:0:15877:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933390dfb000 10000000:01000000:0.0:1788620057.451758:0:15877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933390dfb000 10000000:01000000:0.0:1788620057.451761:0:15877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620057.451767:0:15877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933390dfb000 from 1 10000000:01000000:0.0:1788620057.451783:0:15877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788620057.451822:0:15877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.451831:0:15877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.451842:0:15877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620057.451875:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620057.451961:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.452002:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.452029:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015552 00000100:00100000:0.0:1788620057.452035:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015552 00000100:00100000:0.0:1788620057.452200:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788620057.452209:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677015552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620057.452222:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620057.452235:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbf295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf28e expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.452259:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbf295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf28e expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.452272:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbf295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf28e expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.452280:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788620057.452319:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015552:12345-0@lo:101:mount.lustre.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.452326:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788620057.452373:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620057.452387:0:15877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.452396:0:15877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620057.453823:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788620057.456016:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620057.456378:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788620057.456425:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788620057.456459:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788620057.461656:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788620057.461795:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788620057.461875:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788620057.461915:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788620057.462314:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788620057.462369:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788620057.462403:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788620057.462435:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788620057.462486:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788620057.462545:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788620057.462578:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788620057.462626:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788620057.462664:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788620057.462701:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788620057.462754:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788620057.462821:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788620057.462853:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788620057.462895:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788620057.462943:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788620057.462976:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788620057.463018:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788620057.463493:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788620057.463617:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788620057.463672:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788620057.463734:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788620057.463798:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788620057.463866:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788620057.463901:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788620057.465204:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788620057.465268:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788620057.465335:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788620057.465371:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788620057.465423:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788620057.465461:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788620057.469427:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788620057.469448:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788620057.469698:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620057.469763:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.469833:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620057.473670:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015680 00000100:00100000:1.0:1788620057.473684:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015680 00000100:00100000:1.0:1788620057.473742:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788620057.473753:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620057.474078:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015680:12345-0@lo:501:mount.lustre.0 Request processed in 326us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.474085:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788620057.478225:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620057.478286:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620057.478353:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.478390:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.478410:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015808 00000100:00100000:0.0:1788620057.478417:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015808 00000100:00100000:0.0:1788620057.478464:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788620057.478473:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620057.478920:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015808:12345-0@lo:503:mount.lustre.0 Request processed in 447us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.478928:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788620057.478983:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620057.479477:0:15877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620057.479547:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620057.479593:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.479626:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620057.479822:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677015936 00000100:00100000:2.0:1788620057.479828:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677015936 00000100:00100000:2.0:1788620057.479870:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788620057.479878:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620057.480372:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677015936:12345-0@lo:502:mount.lustre.0 Request processed in 493us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620057.480379:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788620057.480469:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677015936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620057.481432:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788620057.481530:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788620057.481571:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788620057.481620:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788620057.481658:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788620057.481709:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788620057.481743:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788620057.481805:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788620057.481855:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788620057.481887:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788620057.482202:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788620057.482262:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788620057.482319:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788620057.482358:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788620057.482408:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788620057.482446:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788620057.482480:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788620057.482609:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788620057.482649:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788620057.482680:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788620057.482730:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788620057.482768:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788620057.490683:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788620057.490762:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788620057.490820:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788620057.490857:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788620057.490906:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788620057.491596:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788620057.491649:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788620057.491699:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788620057.491732:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788620057.491766:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788620057.491824:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788620057.491873:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788620057.491908:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788620057.492157:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788620057.492197:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788620057.492246:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788620057.492297:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788620057.492334:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788620057.492386:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677016064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620057.493909:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.494162:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acecd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.494618:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016064 00000100:00100000:0.0:1788620057.494627:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016064 00000100:00100000:0.0:1788620057.494680:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788620057.494690:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677016064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620057.495678:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677016064:12345-0@lo:502:mount.lustre.0 Request processed in 985us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.495688:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788620057.495792:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677016064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788620057.495906:0:15877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788620057.495920:0:15877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788620057.499198:0:15887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788620057.499214:0:15887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9332849ccd40) 00000020:00000080:2.0:1788620057.499235:0:15887:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788620057.499320:0:15887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933390dfb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788620057.499324:0:15887:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933390dfb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788620057.499327:0:15887:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933390dfb000 3 00010000:00080000:2.0:1788620057.499355:0:15887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933284ead800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788620057.506842:0:15887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788620057.509821:0:15887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788620057.509863:0:15887:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788620057.509900:0:15887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb0e330328bbf2a3 00000100:00080000:2.0:1788620057.509911:0:15887:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620057.509918:0:15887:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933284ead800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788620057.509966:0:15887:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333c1ed9880 x1875503677016192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788620057.510023:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677016192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788620057.511271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788620057.511338:0:15887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788620057.512829:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016192 00000100:00100000:0.0:1788620057.512841:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016192 00000100:00100000:0.0:1788620057.512883:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620057.512891:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677016192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788620057.512940:0:14479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1788620057.512977:0:14479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb0e330328bbf2aa 00000004:00100000:0.0:1788620057.512993:0:14479:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788620057.513033:0:14479:0:(import.c:65:import_set_state_nolock()) ffff933284df5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620057.513123:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875503677016192:12345-0@lo:38:llog_process_th.0 Request processed in 231us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.513130:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788620057.513156:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620057.513169:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620057.513172:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620057.513174:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620057.513236:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677016320:0@lo:400:kworker.0 00000100:00100000:0.0:1788620057.513269:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.513292:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620057.513297:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677016448:0@lo:400:kworker.0 00000100:00100000:0.0:1788620057.513315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.513336:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016320 00000100:00100000:0.0:1788620057.513339:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016320 00000100:00100000:0.0:1788620057.513358:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016448 00000100:00100000:0.0:1788620057.513360:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016448 00000100:00100000:1.0:1788620057.513381:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620057.513389:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620057.513429:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677016320:12345-0@lo:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000040:00080000:2.0:1788620057.513583:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1788620057.513926:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333c1ed9880 x1875503677016192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620057.513938:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620057.513946:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788620057.513953:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788620057.513958:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788620057.513960:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284ead800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788620057.513967:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677016192:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788620057.513987:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620057.514478:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620057.514492:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620057.514564:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677016448:12345-0@lo:400:kworker.0 Request processed in 77us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.514571:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788620057.514609:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10ca80 x1875503677016448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620057.514619:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677016448:0@lo:400:kworker.0 00010000:00080000:0.0:1788620057.514630:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bc10e680 x1875503677016320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620057.514637:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677016320:0@lo:400:kworker.0 00000020:01000000:0.0:1788620057.516181:0:15877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788620057.516230:0:15877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620057.516255:0:15877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.516267:0:15877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788620057.516316:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788620057.516319:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620057.516320:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620057.516322:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620057.516323:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620057.516324:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620057.516326:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620057.516327:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620057.516329:0:15877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620057.516333:0:15877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788620057.516335:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788620057.516336:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620057.516337:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620057.516338:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620057.516340:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620057.516341:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620057.516342:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620057.516343:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620057.516344:0:15877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620057.516367:0:15877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788620057.516386:0:15877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677016576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620057.516444:0:15877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.516481:0:15877:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.516614:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016576 00000100:00100000:0.0:1788620057.516622:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016576 00000100:00100000:0.0:1788620057.516670:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788620057.516679:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:15877:x1875503677016576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620057.516717:0:14474:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788620057.516732:0:14474:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788620057.522093:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:0.0:1788620057.552687:0:14474:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788620057.552716:0:14474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788620057.554381:0:14495:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788620057.554389:0:14495:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788620057.554412:0:14495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.554429:0:14495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.554436:0:14495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.554473:0:14495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620057.554487:0:14495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 19 pid: 14472 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620057.554501:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677016704:0@lo:104: 00000100:00100000:2.0:1788620057.554569:0:14495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620057.554611:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1788620057.555269:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016704 00000100:00100000:0.0:1788620057.555277:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016704 00000100:00100000:0.0:1788620057.555330:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620057.555339:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677016704:12345-0@lo:104: 00010000:00010000:0.0:1788620057.555352:0:14462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555464:0:14462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620057.555470:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+3:14495:x1875503677016704:12345-0@lo:104: Request processed in 133us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.555477:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788620057.555497:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620057.555503:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555510:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788620057.555513:0:14467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555530:0:14467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620057.555537:0:14467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620057.555543:0:14467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788620057.555597:0:14467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555604:0:14467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620057.555635:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555643:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6200/0xbb0e330328bbf248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf24f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555658:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620057.555660:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620057.555662:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620057.555669:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620057.555680:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677016832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620057.555721:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620057.555758:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016832 00000100:00100000:0.0:1788620057.555762:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016832 00010000:00010000:0.0:1788620057.555809:0:14466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 20 pid: 14472 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620057.555830:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620057.555837:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+20:3310:x1875503677016832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620057.555847:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620057.555852:0:14466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 20 pid: 14472 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555862:0:14466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 20 pid: 14472 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555880:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555897:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788620057.555910:0:14466:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002855071s 00010000:00010000:0.0:1788620057.555915:0:14466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555921:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555928:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555933:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555939:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620057.555944:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555951:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555960:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620057.555970:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620057.555999:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+20:3310:x1875503677016832:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620057.556006:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620057.556085:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677016832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620057.556392:0:14495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d0800/0xbb0e330328bbf24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf248 expref: 19 pid: 14472 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620057.556421:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14495:1875503677016704:0@lo:104: 00010000:00010000:3.0:1788620057.556439:0:14495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.556450:0:14495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.556457:0:14495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620057.556464:0:14495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed6600/0xbb0e330328bbf2b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620057.561670:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:15877:x1875503677016576:12345-0@lo:253:mount.lustre.0 Request processed in 44984us (45217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620057.561685:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788620057.561919:0:15877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:937205a0-294a-4965-a8b3-aa80c7ce7507:15877:1875503677016576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788620057.561935:0:15877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788620057.561938:0:15877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788620057.561939:0:15877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620057.561941:0:15877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620057.561942:0:15877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620057.561943:0:15877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620057.561944:0:15877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620057.561945:0:15877:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620057.561947:0:15877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620057.561948:0:15877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788620057.561963:0:15877:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788620057.566702:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620057.567037:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620057.567194:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620057.567319:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620057.567439:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620057.567628:0:15877:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788620057.568646:0:15877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788620057.621430:0:15877:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788620057.621438:0:15877:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788620057.621478:0:15877:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788620057.621549:0:15877:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788620057.621563:0:15877:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788620057.621593:0:15877:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788620057.741930:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620058.567076:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620042/real 1788620042] req@ffff9333bc10f480 x1875503677009792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.567106:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333bc10f480 x1875503677009792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.567116:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620042/real 1788620042] req@ffff9333bc10c380 x1875503677009920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.567127:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333bc10c380 x1875503677009920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788620058.567146:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620058.567164:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620058.567168:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677009792:0@lo:8:kworker.0 00000100:00080000:3.0:1788620058.567174:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620058.567188:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620058.567192:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677009920:0@lo:8:kworker.0 00000100:00080000:3.0:1788620058.567267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620058.567271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788620058.567273:0:37:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620058.567278:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788620058.567282:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620058.567289:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333a53c0000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620058.567308:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333902c7800 x1875503677017088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788620058.567320:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620058.567323:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788620058.567324:0:37:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620058.567327:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788620058.567329:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620058.567333:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385805800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620058.567342:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333902c7b80 x1875503677017216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620058.567395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677016960:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.567497:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620058.567503:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677017600:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567539:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.567568:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677017344:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567597:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.567616:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620058.567622:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677017472:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567647:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.567677:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677016960 00000100:00100000:3.0:1788620058.567684:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677016960 00000100:00100000:3.0:1788620058.567741:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788620058.567749:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:3310:x1875503677016960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567811:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:3310:x1875503677016960:12345-0@lo:400:kworker.0 Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620058.567817:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788620058.567847:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017600 00000100:00100000:3.0:1788620058.567861:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017600 00000100:00100000:3.0:1788620058.567891:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017344 00000100:00100000:3.0:1788620058.567894:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017344 00000100:00100000:3.0:1788620058.567904:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017472 00000100:00100000:3.0:1788620058.567907:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017472 00000100:00100000:3.0:1788620058.567924:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620058.567931:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677017600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.567961:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677017600:12345-0@lo:400:kworker.0 Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620058.567966:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620058.567978:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620058.567983:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677017344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.568012:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677017344:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620058.568018:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620058.568037:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620058.568043:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677017472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.568071:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677017472:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620058.568076:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788620058.568170:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620058.568193:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c5500 x1875503677017472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.568205:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677017472:0@lo:400:kworker.0 00010000:00080000:3.0:1788620058.568215:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c4380 x1875503677017344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.568223:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677017344:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.568244:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677017088:0@lo:8:kworker.0 00000100:00100000:3.0:1788620058.568271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.568297:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677017216:0@lo:8:kworker.0 00000100:00100000:3.0:1788620058.568314:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788620058.568342:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c6d80 x1875503677017600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.568351:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677017600:0@lo:400:kworker.0 00000100:00100000:3.0:1788620058.568360:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677016960:0@lo:400:kworker.0 00000100:00100000:1.0:1788620058.569459:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017088 00000100:00100000:1.0:1788620058.569470:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017088 00000100:00100000:0.0:1788620058.569608:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017216 00000100:00100000:0.0:1788620058.569613:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017216 00000100:00100000:1.0:1788620058.569635:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620058.569643:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503677017088:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788620058.569672:0:15164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788620058.569697:0:15164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf2b8 00002000:00100000:1.0:1788620058.569711:0:15164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9333bbd76000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788620058.569716:0:15164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788620058.569719:0:15164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788620058.572239:0:15164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620058.572276:0:15164:0:(import.c:65:import_set_state_nolock()) ffff9333bbd77800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620058.572369:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503677017088:12345-0@lo:8:kworker.0 Request processed in 2724us (4096us total) trans 0 rc 0/0 00010000:00080000:3.0:1788620058.574750:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c7800 x1875503677017088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.574765:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620058.574797:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788620058.574807:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788620058.574813:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788620058.574817:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788620058.574837:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788620058.574843:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677017088:0@lo:8:kworker.0 00000004:00080000:3.0:1788620058.574902:0:14502:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788620058.574921:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14502:1875503677017856:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788620058.574975:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.574994:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bbf90780 going to sleep for 11 seconds 00000004:00080000:3.0:1788620058.575009:0:14501:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788620058.575378:0:14501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461543605178ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788620058.575607:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620058.575622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620058.575656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620058.575694:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017728 00000100:00100000:3.0:1788620058.575700:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017728 00000100:00100000:3.0:1788620058.575748:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620058.575756:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503677017728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620058.575807:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620058.575849:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875503677017728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620058.575856:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788620058.575878:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788620058.575900:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c7800 x1875503677017728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620058.575916:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620058.577619:0:15165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620058.577632:0:15165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788620058.577664:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620058.577681:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017856 00000100:00100000:0.0:1788620058.577689:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017856 00000100:00100000:1.0:1788620058.579669:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620058.579707:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620058.579715:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503677017216:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788620058.579748:0:15164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788620058.579790:0:15164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf2bf 00002000:00100000:1.0:1788620058.579807:0:15164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9333bbd77000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788620058.579811:0:15164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788620058.579813:0:15164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788620058.580143:0:15164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788620058.580170:0:15164:0:(import.c:65:import_set_state_nolock()) ffff9333bbd72800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620058.580255:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503677017216:12345-0@lo:8:kworker.0 Request processed in 539us (11938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620058.580261:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620058.580278:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620058.580286:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14502:x1875503677017856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788620058.587828:0:15164:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788620058.587839:0:15164:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788620058.587845:0:15164:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00010000:00080000:0.0:1788620058.596335:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333902c7b80 x1875503677017216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620058.596352:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620058.596362:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788620058.596371:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788620058.596377:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788620058.596380:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788620058.596393:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788620058.596400:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677017216:0@lo:8:kworker.0 00000004:00080000:0.0:1788620058.596465:0:14504:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788620058.596485:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14504:1875503677018112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788620058.596555:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620058.596590:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620058.596604:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677017984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620058.596629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620058.596665:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018112 00000100:00100000:0.0:1788620058.596670:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018112 00000100:00100000:0.0:1788620058.596720:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620058.596728:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14504:x1875503677018112:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788620058.598173:0:14503:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788620058.603199:0:14503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461571425077ns, next at 0ns, rc = 0 00002000:00010000:1.0:1788620058.605862:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.605878:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.605895:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.605907:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.605915:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.605936:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.605949:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.605958:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.605978:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.605993:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.605999:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.606008:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.606013:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.606023:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.608142:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.608172:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67cadb1/0xbb0e330328bbf2c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.608198:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.608202:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.608204:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788620058.609395:0:15166:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788620058.609405:0:15166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788620058.609410:0:15166:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788620058.609607:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.609616:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609629:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.609634:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.609640:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609652:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609662:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609670:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609691:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.609703:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.609714:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609721:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.609726:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609736:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609752:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609759:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf2cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.609797:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.609799:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.609801:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.613121:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.613204:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.613222:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.613227:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.613233:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.613262:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.613271:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.613278:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.613300:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620058.613610:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620058.613618:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.613627:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.613640:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.613651:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.614133:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.614143:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aca30043/0xbb0e330328bbf2d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.614162:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.614163:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.614165:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.615627:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.615640:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.615655:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.615659:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.615665:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.615679:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.615689:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616066:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616085:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.616097:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.616102:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616109:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.616114:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616123:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616214:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616223:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf2db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.616239:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.616241:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.616242:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620058.617977:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620058.618006:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677017984 00000100:00100000:2.0:1788620058.618015:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677017984 00000100:00100000:2.0:1788620058.618131:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620058.618142:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503677017984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620058.618167:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620058.618246:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875503677017984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (21615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620058.618254:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00010000:1.0:1788620058.620568:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.620587:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620603:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.620608:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.620614:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620632:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620642:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620649:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620668:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.620680:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.620685:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620693:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.620697:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620706:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620729:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620737:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbf2e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.620755:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.620757:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.620758:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.622456:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.622467:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622637:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.622642:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.622648:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622660:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622670:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622678:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622710:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.622722:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.622727:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622735:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.622739:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622749:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622764:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622796:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5077400/0xbb0e330328bbf2e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.622814:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.622816:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.622817:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788620058.623874:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9333bc10e680 x1875503677017984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620058.623903:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677017984:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788620058.623926:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788620058.624313:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.624320:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624344:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.624348:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.624354:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624367:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624378:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624386:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624409:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620058.624542:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620058.624549:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.624559:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.624564:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.624575:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.624593:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.624601:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf2f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.624624:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.624627:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.624629:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.624888:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.624894:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624903:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.624907:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.624911:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624921:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624941:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624948:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.624970:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620058.624989:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620058.624995:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.625004:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.625007:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.625027:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.625049:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.625057:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da046d68/0xbb0e330328bbf2f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.625075:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.625077:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.625079:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.625421:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.625428:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.625436:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.625440:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.625444:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.625454:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.625461:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.625468:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.625498:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620058.626244:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.626251:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626261:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.626265:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.626270:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626281:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626290:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626297:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626316:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620058.626327:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.626333:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626341:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc148e4f0) 00002000:00010000:0.0:1788620058.626341:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.626349:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626354:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626365:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626386:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.626392:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626392:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.626399:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626404:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae552cb/0xbb0e330328bbf2fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626425:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626435:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.626435:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626441:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626448:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626454:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.626461:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626463:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.626474:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.626486:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788620058.626919:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.626924:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626933:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.626936:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.626941:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626950:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626969:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626976:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.626984:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620058.627196:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a75cdd7/0xbb0e330328bbf305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627220:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.627224:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627231:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.627235:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627243:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627258:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627266:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f724eee/0xbb0e330328bbf30c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627284:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.627298:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627306:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.627310:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627329:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627341:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627348:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e24fa5a/0xbb0e330328bbf313 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627362:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.627364:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.627366:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620058.627370:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.627378:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.627387:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.627390:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.627395:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.627405:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.627413:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.627421:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.627446:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.627523:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.627529:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627536:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.627540:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627548:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627559:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627579:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc2715d0/0xbb0e330328bbf31a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.627594:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.627596:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.627598:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.628059:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.628065:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628074:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.628077:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.628081:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628090:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628097:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628104:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628119:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.628128:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.628138:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628145:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.628148:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628155:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628166:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628174:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c016be/0xbb0e330328bbf321 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628187:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.628189:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.628190:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.628550:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.628707:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.628713:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628721:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.628725:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.628730:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628751:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628760:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628768:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628833:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.628843:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.628848:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628855:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.628859:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628866:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628877:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628884:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3feb479/0xbb0e330328bbf328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.628905:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.628907:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.628909:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.629581:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.629588:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629599:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.629603:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.629608:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629620:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629628:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629641:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629658:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620058.629735:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620058.629741:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629748:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.629753:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629762:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629796:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629804:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020e8c313/0xbb0e330328bbf32f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.629819:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.629821:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.629823:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.630077:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.630084:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630093:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.630096:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.630101:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630111:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630120:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630203:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630226:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.630631:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.630638:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.630647:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.630650:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.630659:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620058.630702:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.630709:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630731:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.630737:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.630742:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.630746:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630758:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.630759:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf336 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630799:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.630802:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.630806:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.630810:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.630812:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.630834:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.631111:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.631116:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.631123:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.631132:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.631140:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.631150:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.631157:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbf33d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.631169:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.631170:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.631172:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.631842:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.631850:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631860:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.631864:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.631869:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631880:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631900:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631908:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631924:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.631935:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.631940:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631947:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.631951:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631961:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631976:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.631984:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbf344 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632004:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.632013:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.632017:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.632854:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.632861:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632871:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.632875:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.632880:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632890:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632898:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632904:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632920:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.632930:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.632935:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632942:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.632946:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632969:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632982:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.632989:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4fc7283/0xbb0e330328bbf34b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.633004:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.633006:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.633008:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.633018:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.633034:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633049:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.633053:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.633058:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633069:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633077:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633084:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633105:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.633109:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.633115:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.633123:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.633126:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620058.633521:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.633527:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633535:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.633538:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.633541:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633550:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633564:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633571:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.633583:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.634222:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634236:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634257:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccff9265/0xbb0e330328bbf352 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634274:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.634278:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634285:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.634356:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634365:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634376:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634384:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a4466d/0xbb0e330328bbf359 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634397:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.634399:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.634401:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.634410:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620058.634913:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.634926:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634938:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.634942:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.634947:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634959:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634967:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634973:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.634987:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.634996:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.635000:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.635008:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.635011:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.635019:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.635037:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.635045:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009536321b/0xbb0e330328bbf360 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.635062:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.635064:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.635066:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.636382:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.636391:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.636404:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.636408:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.636414:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.636427:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.636437:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.636598:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.636672:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620058.636723:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.636731:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.636740:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.636744:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620058.636748:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.636815:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.636824:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.636833:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620058.637124:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.637130:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.637138:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.637142:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.637146:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.637155:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.637164:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.637172:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637320:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788620058.637327:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637335:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.637340:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637349:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637363:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637377:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000115d0f19/0xbb0e330328bbf367 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637394:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620058.637397:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637404:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.637408:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637416:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637427:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637446:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.637449:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637456:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.637460:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.637479:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788620058.637479:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637502:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.637518:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.637520:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.637522:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.637579:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e382672f/0xbb0e330328bbf36e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.637667:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788620058.637672:0:15166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0a70b8/0xbb0e330328bbf375 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620058.638260:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.638267:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.638281:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.638285:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.638290:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.638300:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.638309:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.638318:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.638358:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.638365:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.638368:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.638379:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.638384:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.638395:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.638413:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.638422:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620058.638426:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.638430:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.638436:0:15166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000226b2131/0xbb0e330328bbf37c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620058.639326:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.639333:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.639343:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.639346:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.639351:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.639373:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.639382:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.639390:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.639707:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.639713:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.639722:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.639726:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.639734:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.639747:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.639755:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.639757:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.639765:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.639895:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788620058.639901:0:15166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf383 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.639988:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.640421:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.640427:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641147:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.641152:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.641158:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641170:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641192:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641200:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641224:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788620058.641834:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.641841:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641851:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.641855:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.641859:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641870:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641879:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641887:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.641911:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788620058.641974:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.641982:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.641993:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.641997:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.642002:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642015:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642024:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642032:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642041:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788620058.642070:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788620058.642078:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642088:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.642097:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.642101:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642113:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642236:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642247:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081f38ee9/0xbb0e330328bbf38a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642267:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.642271:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.642278:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.642281:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620058.642520:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.642527:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642536:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.642540:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.642551:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642561:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642569:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642576:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.642585:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788620058.642859:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.642866:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.642875:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.642879:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.642884:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.642894:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.642903:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.642911:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620058.643068:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.643074:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643082:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.643085:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.643090:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643103:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.643108:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788620058.643115:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643134:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643144:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788620058.643222:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643240:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643248:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5850b6/0xbb0e330328bbf398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643276:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788620058.643280:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643349:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.643355:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643365:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643378:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643386:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf39f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643407:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.643411:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643418:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.643422:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643444:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643456:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643464:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a75cdd7/0xbb0e330328bbf3a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643482:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.643485:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643594:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.643598:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643607:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643619:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643627:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008587eae1/0xbb0e330328bbf3ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.643655:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.643657:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620058.643658:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.643662:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.643666:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.643676:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.643686:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.643691:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.643702:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.643710:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.643718:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620058.643726:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.643728:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620058.643733:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643744:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.643747:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.643752:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643762:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643795:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643803:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.643814:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620058.644120:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.644126:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620058.644329:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.644335:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.644348:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.644351:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.644354:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.644363:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.644371:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.644377:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.644384:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620058.644632:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.644637:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644646:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644658:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644666:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae552cb/0xbb0e330328bbf3b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644681:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.644684:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644691:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.644701:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644709:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644721:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644729:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7180e1/0xbb0e330328bbf3bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644743:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.644747:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644754:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.644757:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644764:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644840:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644849:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8096f5b/0xbb0e330328bbf3c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.644870:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.644872:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.644874:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.645563:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.645571:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.645582:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.645586:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.645591:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.645603:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.645613:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.645628:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.645649:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.645933:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.645940:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.645948:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.645953:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.645964:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.645977:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.645985:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5077400/0xbb0e330328bbf3c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620058.645989:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.645999:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646005:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620058.646008:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788620058.646009:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.646012:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620058.646015:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.646021:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646030:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646051:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646058:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646076:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.646124:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.646139:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646158:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.646162:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646171:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646185:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646194:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005350ad5b/0xbb0e330328bbf3d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.646217:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.646221:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.646224:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.646311:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.646317:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.646325:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.646329:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.646334:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.646343:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.646351:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.646359:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.646380:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620058.646582:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.646589:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646597:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.646601:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.646605:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646614:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646622:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646628:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.646648:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788620058.647151:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.647158:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647166:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.647171:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.647175:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647185:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647193:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647200:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647310:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620058.647316:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647325:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.647331:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647340:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647353:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647360:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062c1e70/0xbb0e330328bbf3d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647384:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.647388:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647395:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.647399:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647407:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.647407:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647426:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647616:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b472a650/0xbb0e330328bbf3de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647634:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.647638:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647645:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.647649:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647656:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647666:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647674:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000307e0ca1/0xbb0e330328bbf3e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.647687:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.647689:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.647697:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.647799:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.647846:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.647860:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620058.647862:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.647868:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.647876:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.647880:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1424d86/0xbb0e330328bbf391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.647893:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.647895:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620058.647896:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620058.647900:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.647907:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647914:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.647920:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.647924:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647930:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647936:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647943:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.647958:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.648240:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.648246:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.648253:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.648256:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.648262:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.648273:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.648279:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3897dd4/0xbb0e330328bbf3ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.648294:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.648297:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.648299:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620058.648396:0:15164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.648401:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.648407:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.648409:0:15164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.648412:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.648418:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.648423:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.648433:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.648735:0:15164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788620058.649056:0:15164:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00002000:00010000:2.0:1788620058.649348:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.649355:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.649365:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.649369:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.649374:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.649380:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.649386:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.649395:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.649399:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.649420:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.649433:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.649440:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc2ca44/0xbb0e330328bbf3f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.649502:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.649528:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.649536:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.649554:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620058.649639:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620058.649645:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.649653:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620058.649657:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.649729:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.649747:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.649754:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7cd3f2/0xbb0e330328bbf3fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.649815:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620058.649819:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620058.649822:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.650122:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.650128:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.650137:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.650140:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.650145:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.650155:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.650163:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.650171:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.650290:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.650296:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.650303:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.650307:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.650313:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620058.650315:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.650337:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.650344:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5d96f20/0xbb0e330328bbf401 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.650358:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.650359:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.650362:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.650385:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620058.650421:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14502:x1875503677017856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 70133us (75441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620058.650430:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620058.650482:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14502:1875503677017856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788620058.650562:0:14502:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788620058.650607:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14502:1875503677018240:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788620058.650642:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620058.650689:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e1f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620058.650703:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018240 00000100:00100000:1.0:1788620058.650709:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018240 00000100:00100000:1.0:1788620058.650746:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620058.650754:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14502:x1875503677018240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788620058.650837:0:15165:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:2.0:1788620058.651081:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.651088:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651096:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.651099:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.651103:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651113:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651120:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651127:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651148:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.651274:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.651281:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.651289:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.651293:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.651301:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.651314:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.651321:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f67cadb1/0xbb0e330328bbf408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.651351:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.651353:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.651355:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620058.651893:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.651901:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651910:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.651919:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.651925:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651936:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651944:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651951:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.651963:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788620058.652760:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620058.652767:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.652798:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788620058.652802:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620058.652807:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.652817:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.652825:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.652838:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620058.652852:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620058.653407:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620058.653415:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653429:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.653434:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653810:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653828:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653837:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da046d68/0xbb0e330328bbf40f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653858:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.653861:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653869:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.653873:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653881:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653893:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653907:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c321fe3/0xbb0e330328bbf416 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.653921:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.653923:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.653925:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620058.656299:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.656311:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.656327:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.656332:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.656339:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.656353:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.656364:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.656372:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.656393:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.656914:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.656922:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.656932:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.656936:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.656946:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.656961:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.656968:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abecbf80/0xbb0e330328bbf41d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.656986:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.656988:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.656989:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.656994:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620058.658035:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14502:x1875503677018240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7274us (7386us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788620058.658046:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620058.658287:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14502:1875503677018240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788620058.658656:0:14502:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:3.0:1788620058.659871:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620058.659884:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.659900:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788620058.659905:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620058.659913:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.660089:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.660101:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620058.660110:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.660913:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.662721:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.662732:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.662745:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.662749:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.662760:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.662797:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.662806:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f739de/0xbb0e330328bbf424 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.662834:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.662836:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.662838:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620058.662854:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.662861:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.662872:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.662876:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.662882:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.662893:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.662903:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.662911:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663209:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620058.663220:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.663224:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663232:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.663235:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663277:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663287:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663294:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094620613/0xbb0e330328bbf42b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.663305:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.663306:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.663307:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620058.664378:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.664387:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.664398:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.664402:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.664407:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.664418:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.664427:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.664446:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.664467:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620058.664920:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620058.664926:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.664934:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620058.664939:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.664948:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.664961:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.664968:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a1e242/0xbb0e330328bbf432 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620058.664982:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.664984:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620058.664986:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620058.665073:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.665080:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665090:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.665093:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.665098:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665108:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665116:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665124:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665137:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788620058.665721:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620058.665728:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665742:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788620058.665746:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620058.665751:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665761:0:15166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665789:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665796:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665809:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620058.665819:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620058.665823:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665829:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.665833:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665841:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665862:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665869:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989e03ad/0xbb0e330328bbf439 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665881:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620058.665884:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665890:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620058.665892:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665899:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665906:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665913:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba051c12/0xbb0e330328bbf440 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620058.665920:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.665922:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620058.665929:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788620058.666101:0:15166:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788620058.666189:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14504:x1875503677018112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69458us (69631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620058.666198:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620058.666248:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14504:1875503677018112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788620058.666262:0:14504:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788620058.666303:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14504:1875503677018368:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788620058.666349:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620058.666379:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620058.666395:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018368 00000100:00100000:0.0:1788620058.666401:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018368 00000100:00100000:0.0:1788620058.666437:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620058.666445:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14504:x1875503677018368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788620058.666480:0:15945:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788620058.668822:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620058.671527:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14504:x1875503677018368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5065us (5160us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788620058.671539:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620058.671726:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14504:1875503677018368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788620058.671741:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788620058.671743:0:14504:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788620058.760698:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788620059.095199:0:14476:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788620059.095207:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933384eee800 from 8 10000000:01000000:2.0:1788620059.095212:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620059.095261:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620059.095273:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620059.095283:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620059.095307:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677018496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620059.095374:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620059.095432:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874ee780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620059.098850:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018496 00000100:00100000:1.0:1788620059.098866:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018496 00000100:00100000:1.0:1788620059.098996:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788620059.099006:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677018496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620059.099022:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620059.099043:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813ce000/0xbb0e330328bbf44e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf447 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620059.099072:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813ce000/0xbb0e330328bbf44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf447 expref: 19 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620059.099084:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813ce000/0xbb0e330328bbf44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf447 expref: 19 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620059.099094:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce000, rc 0) 00000100:00100000:1.0:1788620059.099168:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677018496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620059.099176:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788620059.100808:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677018496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620059.100837:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620059.100850:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620059.100924:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677018624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788620059.100988:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620059.101019:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874ee780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620059.104025:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018624 00000100:00100000:1.0:1788620059.104036:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018624 00000100:00100000:1.0:1788620059.104094:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788620059.104104:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677018624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788620059.104127:0:14473:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788620059.104143:0:14473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788620059.104146:0:14473:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788620059.104266:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677018624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (3277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620059.104273:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788620059.104966:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677018624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788620059.105033:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788620059.105054:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620059.105065:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620059.785122:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620060.808184:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788620060.982419:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788620060.982462:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788620061.832904:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620062.859670:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788620063.015534:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788620063.015563:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788620063.888982:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620063.905591:0:16237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788620063.944149:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677019136:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.944215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.944260:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788620063.944266:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677018752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620063.944289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.944308:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677019264:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.944329:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.944355:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677018880:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.944382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.944403:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677019392:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.944426:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.944443:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788620063.944448:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677019008:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.944466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.946009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677019520:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.946059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.946113:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019136 00000100:00100000:1.0:1788620063.946121:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019136 00000100:00100000:1.0:1788620063.946186:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019008 00000100:00100000:1.0:1788620063.946190:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019008 00000100:00100000:1.0:1788620063.946220:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620063.946230:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620063.946267:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620063.946284:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677019008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.946292:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677019136:12345-0@lo:400:kworker.0 Request processed in 61us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620063.946313:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620063.946352:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677019008:12345-0@lo:400:kworker.0 Request processed in 69us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620063.946359:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620063.946360:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018752 00000100:00100000:1.0:1788620063.946365:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018752 00000100:00100000:1.0:1788620063.946397:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620063.946399:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788620063.946408:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677018752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620063.946420:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677019008:0@lo:400:kworker.0 00002000:00000024:1.0:1788620063.946439:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620063.946486:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677018752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620063.946493:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620063.946510:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019264 00000100:00100000:1.0:1788620063.946513:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019264 00000100:00100000:1.0:1788620063.946529:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019392 00000100:00100000:1.0:1788620063.946531:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019392 00000100:00100000:1.0:1788620063.946543:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019520 00000100:00100000:1.0:1788620063.946545:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019520 00000100:00100000:1.0:1788620063.946555:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620063.946561:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677019264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620063.947846:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620063.947858:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788620063.947877:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677018880 00000100:00100000:3.0:1788620063.947895:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677018880 00000100:00100000:3.0:1788620063.947933:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788620063.947940:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677018880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620063.948003:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677018880:12345-0@lo:400:kworker.0 Request processed in 64us (3620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620063.948010:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788620063.948122:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620063.948130:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677019392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620063.948162:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677019392:12345-0@lo:400:kworker.0 Request processed in 35us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620063.948168:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620063.948181:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620063.948187:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620063.948202:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677019520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620063.948231:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677019520:12345-0@lo:400:kworker.0 Request processed in 30us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620063.948236:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788620063.948691:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677019264:12345-0@lo:400:kworker.0 Request processed in 2129us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620063.948699:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788620063.948722:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620063.948727:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620063.948729:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620063.948750:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677019648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620063.948806:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620063.948859:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677018752:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788620063.948873:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933285998000 x1875503677019264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620063.949996:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677019264:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.950020:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788620063.950035:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677019136:0@lo:400:kworker.0 00000100:00100000:3.0:1788620063.950127:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019648 00000100:00100000:3.0:1788620063.950133:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019648 00000100:00100000:3.0:1788620063.950181:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620063.950190:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677019648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620063.950222:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620063.950276:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677019648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620063.950282:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788620063.951682:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933285999f80 x1875503677019520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620063.951700:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677019520:0@lo:400:kworker.0 00000100:00100000:0.0:1788620063.951887:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677018880:0@lo:400:kworker.0 00010000:00080000:0.0:1788620063.951899:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933285999180 x1875503677019392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620063.951908:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677019392:0@lo:400:kworker.0 00000100:00100000:1.0:1788620063.952860:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677019648:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788620064.265851:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788620064.902937:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620065.927042:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620066.089498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.089607:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099520 00000100:00100000:1.0:1788620066.089617:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099520 00000100:00100000:1.0:1788620066.089666:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788620066.089674:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875503657099520:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788620066.089704:0:14474:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bacb4971-66f0-437c-a1c9-1227bfa78e13@192.168.203.12@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788620066.089734:0:14474:0:(genops.c:1385:class_connect()) connect: client bacb4971-66f0-437c-a1c9-1227bfa78e13, cookie 0xbb0e330328bbf455 00000100:00080000:0.0:1788620066.090134:0:14474:0:(import.c:65:import_set_state_nolock()) ffff93338920f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620066.090202:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+5:2353:x1875503657099520:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 527us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.090210:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788620066.108514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620066.108730:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099648 00000100:00100000:3.0:1788620066.108741:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099648 00000100:00100000:3.0:1788620066.108827:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1788620066.108837:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+5:13788:x1875503657099648:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620066.108854:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620066.108872:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b31c00/0xbb0e330328bbf45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac88 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.108901:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b31c00/0xbb0e330328bbf45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac88 expref: 6 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.108912:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b31c00/0xbb0e330328bbf45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac88 expref: 6 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.108921:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31c00, rc 0) 00000100:00100000:3.0:1788620066.108979:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+6:13788:x1875503657099648:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 143us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620066.109001:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788620066.118597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.118713:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099776 00000100:00100000:0.0:1788620066.118732:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099776 00000100:00100000:0.0:1788620066.118831:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788620066.118841:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+6:13788:x1875503657099776:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788620066.119225:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+6:13788:x1875503657099776:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 383us (646us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620066.119597:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1788620066.129612:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620066.129743:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657099904 00000100:00100000:3.0:1788620066.129754:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657099904 00000100:00100000:3.0:1788620066.129840:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788620066.129851:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+6:13788:x1875503657099904:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620066.129869:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620066.129885:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b31600/0xbb0e330328bbf463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ac8f expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.129914:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b31600/0xbb0e330328bbf463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac8f expref: 7 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.129925:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b31600/0xbb0e330328bbf463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac8f expref: 7 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620066.129934:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31600, rc 0) 00000100:00100000:3.0:1788620066.129998:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+7:13788:x1875503657099904:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620066.130006:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788620066.134095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.135162:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100032 00000100:00100000:0.0:1788620066.135173:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100032 00000100:00100000:0.0:1788620066.135232:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1788620066.135242:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+7:13788:x1875503657100032:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788620066.136178:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13788:x1875503657100032:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 933us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.136187:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788620066.143870:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.143952:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100160 00000100:00100000:0.0:1788620066.143964:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100160 00000100:00100000:0.0:1788620066.144067:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788620066.144078:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13788:x1875503657100160:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788620066.144437:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13788:x1875503657100160:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 361us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.144446:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1788620066.151629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.151940:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100288 00000100:00100000:0.0:1788620066.151950:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100288 00000100:00100000:0.0:1788620066.152013:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1788620066.152023:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13806:x1875503657100288:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620066.152621:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13806:x1875503657100288:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 597us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.152630:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:2.0:1788620066.182554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.182738:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100416 00000100:00100000:0.0:1788620066.182749:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100416 00000100:00100000:0.0:1788620066.182856:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1788620066.182866:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13806:x1875503657100416:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620066.183305:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13806:x1875503657100416:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 439us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.183314:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1788620066.191745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.192158:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100544 00000100:00100000:0.0:1788620066.192168:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100544 00000100:00100000:0.0:1788620066.192261:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788620066.192271:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:13788:x1875503657100544:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620066.192287:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620066.192305:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3000/0xbb0e330328bbf46a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06acb9 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.192335:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3000/0xbb0e330328bbf46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acb9 expref: 9 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.192347:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c3000/0xbb0e330328bbf46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acb9 expref: 9 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.192355:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788620066.192419:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+9:13788:x1875503657100544:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 149us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.192426:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1788620066.198183:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.198327:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100672 00000100:00100000:0.0:1788620066.198337:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100672 00000100:00100000:0.0:1788620066.198390:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788620066.198401:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+9:13788:x1875503657100672:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788620066.198441:0:14472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788620066.198469:0:14472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788620066.198474:0:14472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788620066.198477:0:14472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788620066.198479:0:14472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788620066.200079:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+9:13788:x1875503657100672:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 1669us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.200093:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788620066.207972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.208331:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100800 00000100:00100000:0.0:1788620066.208342:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100800 00000100:00100000:0.0:1788620066.208442:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788620066.208452:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+9:13788:x1875503657100800:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620066.208481:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620066.208499:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06acc0 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.208528:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 10 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.208540:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 10 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620066.208549:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2600, rc 0) 00000100:00100000:0.0:1788620066.208616:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13788:x1875503657100800:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 158us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.208623:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1788620066.212309:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.212416:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657100928 00000100:00100000:0.0:1788620066.212439:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657100928 00000100:00100000:1.0:1788620066.212575:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788620066.212585:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13788:x1875503657100928:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788620066.212873:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13788:x1875503657100928:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 288us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.212881:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1788620066.216357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.216450:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101056 00000100:00100000:1.0:1788620066.216473:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101056 00000100:00100000:1.0:1788620066.216529:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788620066.216539:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13788:x1875503657101056:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788620066.216935:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13788:x1875503657101056:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 396us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.216944:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1788620066.224509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.225379:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101184 00000100:00100000:0.0:1788620066.225390:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101184 00000100:00100000:0.0:1788620066.225434:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1788620066.225443:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13810:x1875503657101184:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620066.226333:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13810:x1875503657101184:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 885us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.226343:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1788620066.231238:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620066.231361:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101312 00000100:00100000:3.0:1788620066.231372:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101312 00000100:00100000:3.0:1788620066.231425:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1788620066.231435:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13810:x1875503657101312:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620066.231710:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13810:x1875503657101312:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 274us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620066.233352:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:2.0:1788620066.238385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620066.238964:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101440 00000100:00100000:3.0:1788620066.238975:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101440 00000100:00100000:3.0:1788620066.239084:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620066.239093:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875503657101440:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788620066.239122:0:14479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6eb10b78-2640-4d1c-bba9-c870a1e66de6@192.168.203.12@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788620066.239184:0:14479:0:(genops.c:1385:class_connect()) connect: client 6eb10b78-2640-4d1c-bba9-c870a1e66de6, cookie 0xbb0e330328bbf478 00000004:00100000:3.0:1788620066.239213:0:14479:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788620066.239219:0:14479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788620066.300929:0:14479:0:(import.c:65:import_set_state_nolock()) ffff93338580a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620066.301122:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2353:x1875503657101440:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 62027us (62744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620066.301132:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788620066.305019:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620066.305105:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.305599:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101696 00000100:00100000:1.0:1788620066.305670:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101696 00000100:00100000:1.0:1788620066.305832:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101568 00000100:00100000:1.0:1788620066.305837:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101568 00000100:00100000:1.0:1788620066.305865:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788620066.305874:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:13788:x1875503657101696:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788620066.305916:0:14480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620066.305942:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788620066.305952:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:0:x1875503657101568:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788620066.305964:0:16239:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620066.305997:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:0:x1875503657101568:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 47us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.306001:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:13788:x1875503657101696:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 129us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.306005:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788620066.306007:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788620066.307942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620066.308109:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101824 00000100:00100000:0.0:1788620066.308119:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101824 00000100:00100000:0.0:1788620066.308172:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620066.308182:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13788:x1875503657101824:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788620066.308265:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13788:x1875503657101824:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620066.308273:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620066.310587:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.310735:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657101952 00000100:00100000:1.0:1788620066.310745:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657101952 00000100:00100000:1.0:1788620066.310818:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788620066.310825:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875503657101952:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788620066.310855:0:15164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6eb10b78-2640-4d1c-bba9-c870a1e66de6@192.168.203.12@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788620066.310885:0:15164:0:(genops.c:1385:class_connect()) connect: client 6eb10b78-2640-4d1c-bba9-c870a1e66de6, cookie 0xbb0e330328bbf47f 00002000:00100000:1.0:1788620066.310896:0:15164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6eb10b78-2640-4d1c-bba9-c870a1e66de6/ffff9333bbd70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620066.310919:0:15164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788620066.311102:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1788620066.311273:0:15164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620066.311315:0:15164:0:(import.c:65:import_set_state_nolock()) ffff9333bbd74000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620066.311384:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2353:x1875503657101952:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 558us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.311392:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788620066.312882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620066.312922:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.313043:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102080 00000100:00100000:1.0:1788620066.313054:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102080 00000100:00100000:1.0:1788620066.313116:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788620066.313124:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875503657102080:12345-192.168.203.12@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788620066.313142:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102208 00000100:00100000:0.0:1788620066.313146:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102208 00010000:00080000:1.0:1788620066.313152:0:15165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6eb10b78-2640-4d1c-bba9-c870a1e66de6@192.168.203.12@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788620066.313178:0:15165:0:(genops.c:1385:class_connect()) connect: client 6eb10b78-2640-4d1c-bba9-c870a1e66de6, cookie 0xbb0e330328bbf486 00000100:00100000:0.0:1788620066.313186:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:1.0:1788620066.313189:0:15165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6eb10b78-2640-4d1c-bba9-c870a1e66de6/ffff933390df8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788620066.313193:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13788:x1875503657102208:12345-192.168.203.12@tcp:33:mount.lustre.0 00002000:00100000:1.0:1788620066.313210:0:15165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788620066.313567:0:15165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788620066.313594:0:15165:0:(import.c:65:import_set_state_nolock()) ffff933390dff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620066.313649:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2353:x1875503657102080:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 524us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.313656:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000004:00080000:2.0:1788620066.314245:0:14482:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 991us 00000004:00200000:2.0:1788620066.327414:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788620066.327529:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13788:x1875503657102208:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 14331us (14648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620066.327542:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788620066.507041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620066.507278:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102336 00000100:00100000:1.0:1788620066.507289:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102336 00000100:00100000:1.0:1788620066.507349:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620066.507359:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13831:x1875503657102336:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1788620066.507378:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620066.507402:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbf48d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06acea expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507480:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507494:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507509:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620066.507562:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788620066.507692:0:14481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620066.507898:0:14481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507928:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfc00/0xbb0e330328bbf48d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acea expref: 8 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507945:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acea expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620066.507954:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620066.507956:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620066.507960:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce400, rc 0) 00000100:00100000:1.0:1788620066.508022:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:13831:x1875503657102336:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 665us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620066.508029:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:1.0:1788620066.951956:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620067.975063:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788620068.101522:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000100:00100000:1.0:1788620068.710911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620068.711003:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102464 00000100:00100000:0.0:1788620068.711013:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102464 00000100:00100000:0.0:1788620068.711086:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788620068.711099:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:13884:x1875503657102464:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1788620068.711141:0:16239:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620068.711246:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:13884:x1875503657102464:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620068.711253:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788620068.714246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620068.714335:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102592 00000100:00100000:3.0:1788620068.714345:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102592 00000100:00100000:3.0:1788620068.714406:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620068.714416:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13884:x1875503657102592:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1788620068.714461:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620068.714563:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:13884:x1875503657102592:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620068.714571:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00080000:2.0:1788620068.716068:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620068.716077:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620068.722285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620068.724906:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102720 00000100:00100000:1.0:1788620068.724919:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102720 00000100:00080000:2.0:1788620068.725061:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620068.725102:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788620068.725112:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:13884:x1875503657102720:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1788620068.725146:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620068.725233:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:13884:x1875503657102720:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 122us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620068.725252:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788620068.932124:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620068.932348:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102848 00000100:00100000:3.0:1788620068.932362:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102848 00000100:00100000:3.0:1788620068.932457:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1788620068.932468:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:13918:x1875503657102848:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620068.932492:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620068.932516:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333b8b31400/0xbb0e330328bbf49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06acf1 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620068.932556:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333b8b31400/0xbb0e330328bbf49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acf1 expref: 11 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620068.932572:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333b8b31400/0xbb0e330328bbf49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acf1 expref: 11 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620068.932584:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31400, rc 0) 00000100:00100000:3.0:1788620068.932677:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657102848:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 211us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620068.932685:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1788620068.946966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620068.950886:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657102976 00000100:00100000:1.0:1788620068.950911:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657102976 00000100:00100000:1.0:1788620068.951006:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788620068.951018:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657102976:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788620068.951765:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657102976:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 745us (4876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620068.951798:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1788620068.965006:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620068.965314:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103104 00000100:00100000:0.0:1788620068.965328:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103104 00000100:00100000:0.0:1788620068.965400:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:0.0:1788620068.965412:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657103104:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788620068.965730:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657103104:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 319us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620068.965739:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:0.0:1788620068.970296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620068.970424:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103232 00000100:00100000:1.0:1788620068.970447:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103232 00000100:00100000:1.0:1788620068.970651:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788620068.970664:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13923:x1875503657103232:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620068.973711:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13923:x1875503657103232:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 3031us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620068.973732:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788620068.984697:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620068.986342:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103360 00000100:00100000:3.0:1788620068.986361:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103360 00000100:00100000:3.0:1788620068.986615:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1788620068.986630:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13923:x1875503657103360:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620068.987072:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13923:x1875503657103360:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 443us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620068.987081:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00010000:00010000:2.0:1788620069.000484:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620069.004910:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.005419:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103488 00000100:00100000:1.0:1788620069.005433:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103488 00000100:00100000:1.0:1788620069.005519:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788620069.005531:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bcb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13918:x1875503657103488:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620069.005556:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620069.005582:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813ce600/0xbb0e330328bbf4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad1b expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.005630:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813ce600/0xbb0e330328bbf4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad1b expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.005663:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813ce600/0xbb0e330328bbf4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad1b expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.005674:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce600, rc 0) 00000100:00100000:1.0:1788620069.005754:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bcb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13918:x1875503657103488:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 225us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.005762:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788620069.012315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620069.012470:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103616 00000100:00100000:3.0:1788620069.012484:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103616 00000100:00100000:3.0:1788620069.012557:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788620069.012570:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13918:x1875503657103616:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788620069.012630:0:14473:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788620069.012649:0:14473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788620069.012654:0:14473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788620069.012658:0:14473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788620069.012661:0:14473:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788620069.017053:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13918:x1875503657103616:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 4468us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620069.017071:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1788620069.020474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620069.020655:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103744 00000100:00100000:0.0:1788620069.020668:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103744 00000100:00100000:1.0:1788620069.021203:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788620069.021221:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13918:x1875503657103744:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620069.021354:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620069.021381:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad22 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.021420:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.021433:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620069.021454:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:1.0:1788620069.021583:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13918:x1875503657103744:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 367us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.021600:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788620069.025143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620069.025392:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657103872 00000100:00100000:3.0:1788620069.025409:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657103872 00000100:00100000:2.0:1788620069.025617:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788620069.025631:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13918:x1875503657103872:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788620069.026512:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13918:x1875503657103872:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 879us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620069.026524:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788620069.029911:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620069.030696:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104000 00000100:00100000:3.0:1788620069.030852:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104000 00000100:00100000:3.0:1788620069.030998:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1788620069.031012:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13918:x1875503657104000:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788620069.031335:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13918:x1875503657104000:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 324us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620069.031344:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1788620069.034003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.034295:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104128 00000100:00100000:1.0:1788620069.034310:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104128 00000100:00100000:1.0:1788620069.034380:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788620069.034392:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13928:x1875503657104128:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620069.035430:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13928:x1875503657104128:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 1030us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.035454:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788620069.038320:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620069.038447:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104256 00000100:00100000:0.0:1788620069.038460:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104256 00000100:00100000:0.0:1788620069.038583:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1788620069.038604:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13928:x1875503657104256:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620069.039009:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13928:x1875503657104256:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 415us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620069.039018:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788620069.050982:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.051137:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104384 00000100:00100000:1.0:1788620069.051152:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104384 00000100:00100000:1.0:1788620069.051217:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788620069.051229:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875503657104384:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788620069.051273:0:14479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9fa1a06f-2672-4b8a-a479-ea28f38363d8@192.168.203.12@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788620069.051331:0:14479:0:(genops.c:1385:class_connect()) connect: client 9fa1a06f-2672-4b8a-a479-ea28f38363d8, cookie 0xbb0e330328bbf4b0 00000004:00100000:1.0:1788620069.051375:0:14479:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788620069.051567:0:14479:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620069.051677:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2353:x1875503657104384:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 448us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.051686:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620069.058358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620069.058420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.064975:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104512 00000100:00100000:1.0:1788620069.064998:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104512 00000100:00100000:1.0:1788620069.065095:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104640 00000100:00100000:1.0:1788620069.065100:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104640 00000100:00100000:1.0:1788620069.065131:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620069.065144:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+7:0:x1875503657104512:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788620069.065209:0:14480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788620069.065327:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+7:0:x1875503657104512:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 185us (6992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.065336:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620069.065359:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788620069.065367:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657104640:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788620069.065379:0:14480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788620069.065400:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657104640:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 35us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.065407:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788620069.065580:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677020160:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.067696:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.067806:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788620069.067820:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677019776:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.067889:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.067918:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677020288:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.067943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.067982:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020160 00000100:00100000:1.0:1788620069.067992:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020160 00000100:00100000:1.0:1788620069.068037:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020288 00000100:00100000:1.0:1788620069.068040:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020288 00000100:00100000:1.0:1788620069.068061:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620069.068071:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068131:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677020160:12345-0@lo:400:kworker.0 Request processed in 61us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.068138:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620069.068156:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620069.068170:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068214:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677020288:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.068221:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620069.068264:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677020288:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068278:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677020160:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068313:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019776 00000100:00100000:1.0:1788620069.068317:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019776 00000100:00100000:1.0:1788620069.068346:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788620069.068353:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3311:x1875503677019776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068388:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3311:x1875503677019776:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.068395:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788620069.068418:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677019776:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068495:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93328599b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677019904:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.068557:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068578:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.068921:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620069.068930:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677020032:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.068960:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.068992:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677019904 00000100:00100000:1.0:1788620069.068997:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677019904 00000100:00100000:1.0:1788620069.069036:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020032 00000100:00100000:1.0:1788620069.069039:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020032 00000100:00100000:1.0:1788620069.069077:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620069.069084:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677019904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.069126:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677019904:12345-0@lo:400:kworker.0 Request processed in 43us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.069133:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620069.069145:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620069.069151:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.069179:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677020032:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.069185:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620069.069215:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677020032:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.069225:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93328599b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677019904:0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.069243:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020416 00000100:00100000:1.0:1788620069.069247:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020416 00000100:00100000:1.0:1788620069.069274:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788620069.069279:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677020416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620069.069311:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677020416:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.069316:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788620069.069340:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677020416:0@lo:400:kworker.0 00000100:00100000:3.0:1788620069.070474:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620069.070552:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620069.072820:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020544 00000100:00100000:1.0:1788620069.072841:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020544 00000100:00100000:1.0:1788620069.072907:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620069.072919:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677020544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620069.072954:0:15168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620069.073076:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677020544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.073084:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620069.073235:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677020544:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788620069.073359:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620069.073367:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620069.073372:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620069.073495:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620069.073510:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677020672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620069.073565:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620069.073866:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020672 00000100:00100000:2.0:1788620069.073873:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020672 00000100:00100000:2.0:1788620069.073912:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788620069.073927:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677020672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620069.073947:0:15168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620069.073990:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333902c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677020672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620069.073997:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620069.074121:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677020672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620069.076205:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620069.076262:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104768 00000100:00100000:0.0:1788620069.076276:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104768 00000100:00100000:1.0:1788620069.076409:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788620069.076422:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657104768:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788620069.076544:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657104768:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 123us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.076552:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788620069.084153:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.084283:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657104896 00000100:00100000:1.0:1788620069.084298:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657104896 00000100:00100000:1.0:1788620069.084365:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620069.084377:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875503657104896:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788620069.084419:0:15164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9fa1a06f-2672-4b8a-a479-ea28f38363d8@192.168.203.12@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788620069.084469:0:15164:0:(genops.c:1385:class_connect()) connect: client 9fa1a06f-2672-4b8a-a479-ea28f38363d8, cookie 0xbb0e330328bbf4b7 00002000:00100000:1.0:1788620069.084483:0:15164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fa1a06f-2672-4b8a-a479-ea28f38363d8/ffff9333bbc5b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620069.084497:0:15164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788620069.084819:0:15164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620069.084862:0:15164:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620069.085216:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2353:x1875503657104896:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 838us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.085226:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788620069.087809:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.088381:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105152 00000100:00100000:1.0:1788620069.088397:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105152 00000100:00100000:1.0:1788620069.088470:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788620069.088484:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657105152:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788620069.088620:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788620069.088718:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13918:x1875503657105152:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 232us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.088727:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788620069.089406:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620069.090352:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105024 00000100:00100000:1.0:1788620069.090366:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105024 00000100:00100000:1.0:1788620069.090425:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788620069.090434:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875503657105024:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788620069.090489:0:15945:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9fa1a06f-2672-4b8a-a479-ea28f38363d8@192.168.203.12@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788620069.090530:0:15945:0:(genops.c:1385:class_connect()) connect: client 9fa1a06f-2672-4b8a-a479-ea28f38363d8, cookie 0xbb0e330328bbf4be 00002000:00100000:1.0:1788620069.090546:0:15945:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9fa1a06f-2672-4b8a-a479-ea28f38363d8/ffff9333bbc58000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620069.090560:0:15945:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788620069.091136:0:15945:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788620069.091188:0:15945:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620069.091351:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2353:x1875503657105024:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 915us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620069.091361:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788620069.269226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620069.269426:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105280 00000100:00100000:3.0:1788620069.269449:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105280 00000100:00100000:3.0:1788620069.269527:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788620069.269540:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:13949:x1875503657105280:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1788620069.269567:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620069.269613:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30a00/0xbb0e330328bbf4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad4c expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269702:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269719:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269735:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620069.269820:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788620069.269824:0:14481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620069.269853:0:14481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269883:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30a00/0xbb0e330328bbf4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 8 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269911:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620069.269940:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620069.269943:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620069.269948:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30400, rc 0) 00000100:00100000:3.0:1788620069.270207:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+7:13949:x1875503657105280:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 667us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620069.270216:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:1.0:1788620070.027234:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620071.047635:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620071.254988:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000001:00100000:3.0:1788620071.255008:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000001:00100000:1.0:1788620071.697915:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000001:00100000:1.0:1788620071.697940:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000001:02000400:0.0:1788620071.941406:0:16444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788620072.070931:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620073.095230:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620073.325607:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00010000:00010000:0.0:1788620074.120679:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620074.182967:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677020800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620074.183038:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620074.183103:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677020928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620074.183137:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620074.183173:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020800 00000100:00100000:3.0:1788620074.183182:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020800 00000100:00080000:1.0:1788620074.183252:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620074.183286:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677020928 00000100:00100000:2.0:1788620074.183291:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677020928 00000100:00100000:2.0:1788620074.183344:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788620074.183344:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620074.183358:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677020928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620074.183397:0:15168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620074.183547:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677020928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620074.183555:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620074.183583:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677021056:0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.183615:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620074.183649:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620074.183655:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677021440:0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.183682:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620074.183711:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677021184:0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.183744:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620074.183767:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620074.183800:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620074.183813:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677020800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620074.183814:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677021312:0@lo:400:kworker.0 00002000:00000024:3.0:1788620074.183842:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620074.183851:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620074.183890:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677020800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620074.183899:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021056 00000100:00100000:3.0:1788620074.183900:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788620074.183904:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021440 00000100:00100000:1.0:1788620074.183907:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021056 00000100:00100000:2.0:1788620074.183911:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021440 00000100:00100000:1.0:1788620074.183947:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788620074.183957:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677021056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.183960:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021184 00000100:00100000:2.0:1788620074.183965:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021184 00000100:00100000:2.0:1788620074.183983:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021312 00000100:00100000:2.0:1788620074.183985:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021312 00000100:00100000:2.0:1788620074.184000:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620074.184007:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677021440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.184044:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677021440:12345-0@lo:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620074.184050:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620074.184067:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788620074.184075:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620074.184076:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677021184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620074.184090:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677021312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620074.184164:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677020928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620074.184199:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677020800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620074.184338:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677021056:12345-0@lo:400:kworker.0 Request processed in 383us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620074.184346:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788620074.184540:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677021312:12345-0@lo:400:kworker.0 Request processed in 455us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620074.184547:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788620074.184624:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620074.184650:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788620074.184676:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677021056:0@lo:400:kworker.0 00000100:00100000:2.0:1788620074.187173:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677021184:12345-0@lo:400:kworker.0 Request processed in 3091us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620074.187185:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620074.188265:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677021312:0@lo:400:kworker.0 00000100:00100000:3.0:1788620074.188292:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677021184:0@lo:400:kworker.0 00000100:00100000:1.0:1788620074.396551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620074.396590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620074.396654:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620074.396675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620074.396716:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105408 00000100:00100000:2.0:1788620074.396726:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105408 00000100:00100000:0.0:1788620074.396803:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788620074.396815:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2354:x1875503657105408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620074.396897:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2354:x1875503657105408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620074.396906:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1788620074.397055:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620074.397208:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105664 00000100:00100000:3.0:1788620074.397214:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105664 00000100:00100000:3.0:1788620074.397256:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106176 00000100:00100000:3.0:1788620074.397259:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106176 00000100:00100000:3.0:1788620074.397285:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620074.397293:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657105664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620074.397332:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657105664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620074.397339:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620074.397354:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788620074.397360:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657106176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620074.397384:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657106176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620074.397391:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00080000:3.0:1788620074.398316:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620074.398324:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620074.398426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620074.398964:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105920 00000100:00100000:1.0:1788620074.398969:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620074.398973:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105920 00000100:00100000:2.0:1788620074.399027:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105536 00000100:00100000:2.0:1788620074.399030:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105536 00000100:00100000:2.0:1788620074.399064:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788620074.399073:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657105920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620074.399135:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657105920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 64us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620074.399167:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788620074.399185:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788620074.399191:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2354:x1875503657105536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620074.399216:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2354:x1875503657105536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620074.399221:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788620074.402719:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657105792 00000100:00100000:3.0:1788620074.402735:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657105792 00000100:00100000:3.0:1788620074.402825:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106048 00000100:00100000:3.0:1788620074.402829:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106048 00000100:00100000:3.0:1788620074.402854:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788620074.402864:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657105792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620074.402939:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657105792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620074.402948:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788620074.402966:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788620074.402972:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657106048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620074.402996:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657106048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620074.403002:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00080000:2.0:1788620074.403240:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620074.403245:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620074.403248:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788620074.506642:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788620075.143065:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788620075.664342:0:16593:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd03053eb0 20000000:00000080:2.0:1788620075.664359:0:16593:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933387122800 uarg=0000000000000000 20000000:01000000:2.0:1788620075.664404:0:16593:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788620075.664410:0:16593:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788620075.664414:0:16593:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788620075.666016:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788620075.666241:0:16593:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788620075.684977:0:16593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788620075.689334:0:16593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689355:0:16593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689363:0:16593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 18 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689371:0:16593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689380:0:16593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689409:0:16593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.689418:0:16593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.690213:0:16593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.690232:0:16593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.690247:0:16593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021568:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620075.691590:0:16593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.691608:0:16593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.691620:0:16593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021696:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620075.694189:0:16593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.694206:0:16593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 18 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.694220:0:16593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021824:0@lo:104: 00000100:00100000:2.0:1788620075.694265:0:16593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620075.694326:0:16593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 18 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.694334:0:16593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 18 pid: 14472 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.694342:0:16593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021952:0@lo:104: 00000100:00100000:2.0:1788620075.694362:0:16593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620075.694399:0:16593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 18 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.694408:0:16593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 18 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.694416:0:16593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677022080:0@lo:104: 00000100:00100000:2.0:1788620075.694441:0:16593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620075.694451:0:16593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620075.694635:0:14462:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788620075.694676:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021824 00000100:00100000:1.0:1788620075.694682:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021824 00000100:00100000:1.0:1788620075.694719:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677021952 00000100:00100000:1.0:1788620075.694722:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677021952 00000100:00100000:1.0:1788620075.694732:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022080 00000100:00100000:1.0:1788620075.694734:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022080 00000100:00100000:1.0:1788620075.694748:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620075.694756:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+5:16593:x1875503677021824:12345-0@lo:104: 00010000:00010000:1.0:1788620075.694769:0:14463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620075.694861:0:16593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021568:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620075.695989:0:16593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021696:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620075.697076:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620075.697211:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106304 00000100:00100000:3.0:1788620075.697220:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106304 00010000:00010000:3.0:1788620075.697256:0:14466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620075.697299:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620075.697308:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657106304:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620075.697321:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620075.697327:0:14466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.697339:0:14466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.697357:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cfa00/0xbb0e330328bbf4a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad22 expref: 13 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.697405:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620075.697455:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:2355:x1875503657106304:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 147us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620075.697463:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788620075.698627:0:14462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788620075.698638:0:14462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788620075.700048:0:16595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620075.700074:0:16595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+5:16593:x1875503677021952:12345-0@lo:104: 00010000:00010000:2.0:1788620075.700095:0:16595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.700220:0:16595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620075.700227:0:16595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+5:16593:x1875503677021952:12345-0@lo:104: Request processed in 169us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620075.700233:0:16595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620075.700267:0:16595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620075.700273:0:16595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc7c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+4:16593:x1875503677022080:12345-0@lo:104: 00010000:00010000:2.0:1788620075.700282:0:16595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620075.700430:0:16593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021952:0@lo:104: 00000100:00100000:3.0:1788620075.700440:0:16593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677022080:0@lo:104: 00010000:00010000:0.0:1788620075.701614:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788620075.701624:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701634:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7a00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788620075.701638:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701669:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620075.701677:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620075.701683:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620075.701728:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701734:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620075.701753:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701761:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7a00/0xbb0e330328bbf210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf217 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701790:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620075.701793:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701798:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3a00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788620075.701800:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701806:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620075.701811:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620075.701823:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620075.701838:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701843:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620075.701856:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701862:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3a00/0xbb0e330328bbf1c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf1ca expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701870:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620075.701873:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701878:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:0.0:1788620075.701881:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701888:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620075.701894:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620075.701898:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620075.701908:0:14468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701913:0:14468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620075.701925:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701931:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbf280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf287 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.701945:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620075.701947:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620075.701949:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620075.701974:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677022208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620075.702013:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620075.702075:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677022336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620075.702100:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620075.702118:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620075.702123:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677022464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620075.702141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620075.702169:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022208 00000100:00100000:0.0:1788620075.702174:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022208 00010000:00010000:0.0:1788620075.702200:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 19 pid: 14472 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620075.702218:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022336 00000100:00100000:0.0:1788620075.702220:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022336 00010000:00010000:0.0:1788620075.702230:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 20 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620075.702239:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022464 00000100:00100000:0.0:1788620075.702242:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022464 00010000:00010000:0.0:1788620075.702251:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 21 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620075.702279:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620075.702286:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+21:3310:x1875503677022208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620075.702298:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620075.702303:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 21 pid: 14472 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702313:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 21 pid: 14472 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702327:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbf217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf210 expref: 21 pid: 14472 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702340:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620075.702370:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+20:3310:x1875503677022208:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620075.702377:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620075.702404:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620075.702410:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bafb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3311:x1875503677022336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620075.702417:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620075.702421:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 19 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702428:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 19 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702438:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed7800/0xbb0e330328bbf1ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf1c3 expref: 19 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702456:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620075.702481:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bafb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:3311:x1875503677022336:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620075.702486:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620075.702522:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620075.702528:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:3311:x1875503677022464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620075.702534:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620075.702538:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 17 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702545:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 17 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620075.702554:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620075.702573:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:3311:x1875503677022464:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620075.702579:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620075.702613:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677022208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620075.702636:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677022464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620075.702643:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677022336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620075.706417:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf280 expref: 16 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620075.706440:0:16593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16593:1875503677021824:0@lo:104: 00010000:00010000:3.0:1788620075.706477:0:16593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620075.706616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620075.706700:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106432 00000100:00100000:3.0:1788620075.706706:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106432 00010000:00010000:3.0:1788620075.706739:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620075.706792:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788620075.706802:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:2354:x1875503657106432:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620075.706816:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620075.706822:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706834:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706868:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbf471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acc0 expref: 12 pid: 14474 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706882:0:14464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706890:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706906:0:14464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706913:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706920:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706927:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706933:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620075.706937:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706944:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706958:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.706979:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620075.707032:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:2354:x1875503657106432:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 231us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620075.707040:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:3.0:1788620075.707065:0:16593:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.707085:0:16593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620075.707091:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc142000/0xbb0e330328bbf4d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620075.709177:0:16595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788620075.709194:0:16595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc7c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+4:16593:x1875503677022080:12345-0@lo:104: Request processed in 8916us (14747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620075.709207:0:16595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788620075.710375:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620075.714185:0:14463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788620075.714205:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+3:16593:x1875503677021824:12345-0@lo:104: Request processed in 19443us (19934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620075.714230:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788620075.714324:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620076.170878:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788620076.870906:0:14476:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620076.870914:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933390dfb000 from 10 10000000:01000000:3.0:1788620076.870920:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620076.870963:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.870974:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.870984:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620076.871009:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.871075:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620076.871118:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.871282:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022592 00000100:00100000:1.0:1788620076.871290:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022592 00000100:00100000:1.0:1788620076.871345:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788620076.871355:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+16:14476:x1875503677022592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620076.871368:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620076.871392:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cf800/0xbb0e330328bbf4e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf4da expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.871417:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cf800/0xbb0e330328bbf4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf4da expref: 17 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.871977:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cf800/0xbb0e330328bbf4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf4da expref: 17 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.871986:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf800, rc 0) 00000100:00100000:1.0:1788620076.872042:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 688us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.872049:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788620076.872098:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620076.872115:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.872124:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620076.872179:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620076.872217:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620076.872234:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.872262:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022720 00000100:00100000:1.0:1788620076.872266:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022720 00000100:00100000:1.0:1788620076.872294:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788620076.872300:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620076.875183:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2873us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.875197:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788620076.875975:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.876055:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.876114:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620076.876188:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620076.876493:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022848 00000100:00100000:2.0:1788620076.876500:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022848 00000100:00100000:2.0:1788620076.876587:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788620076.876598:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620076.876808:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285529450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620076.876815:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788620076.876893:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788620076.877692:0:16646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788620076.877754:0:14476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788620076.877768:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620076.877801:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.877810:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620076.877820:0:14476:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620076.877823:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933387e54000 from 10 10000000:01000000:3.0:1788620076.877825:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620076.877854:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.877862:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.877872:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620076.877891:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.877931:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620076.878063:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.878165:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677022976 00000100:00100000:1.0:1788620076.878172:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677022976 00000100:00100000:1.0:1788620076.878202:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788620076.878210:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+17:14476:x1875503677022976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620076.878220:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620076.878234:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbf4ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf4e8 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.878369:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbf4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf4e8 expref: 18 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.878380:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbf4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf4e8 expref: 18 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.878398:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfc00, rc 0) 00000100:00100000:1.0:1788620076.878554:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677022976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.878562:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788620076.878661:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677022976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620076.878675:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620076.878683:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620076.878730:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.878757:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620076.878879:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.878909:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023104 00000100:00100000:1.0:1788620076.878921:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023104 00000100:00100000:1.0:1788620076.878985:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788620076.878992:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328552b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677023104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620076.879218:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328552b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677023104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.879225:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788620076.879341:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.879369:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620076.879419:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620076.879629:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.879658:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023232 00000100:00100000:1.0:1788620076.879662:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023232 00000100:00100000:1.0:1788620076.879683:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788620076.879689:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677023232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620076.879865:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677023232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.879873:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788620076.879964:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620076.881920:0:16647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788620076.884601:0:14476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788620076.884634:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620076.884648:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.884661:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620076.884672:0:14476:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788620076.884674:0:14476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933384eee800 from 10 10000000:01000000:2.0:1788620076.884677:0:14476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620076.884718:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.884738:0:14476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.884750:0:14476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620076.884799:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620076.884868:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620076.884917:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.885205:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023360 00000100:00100000:1.0:1788620076.885213:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023360 00000100:00100000:1.0:1788620076.885336:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788620076.885346:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+18:14476:x1875503677023360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620076.885358:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620076.885370:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333813cf600/0xbb0e330328bbf4fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf4f6 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.885474:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333813cf600/0xbb0e330328bbf4fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf4f6 expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.885488:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333813cf600/0xbb0e330328bbf4fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf4f6 expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.885497:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf600, rc 0) 00000100:00100000:1.0:1788620076.885563:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677023360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.885569:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788620076.886485:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620076.886516:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620076.886528:0:14476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620076.886599:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620076.886640:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620076.886667:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620076.887536:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023488 00000100:00100000:2.0:1788620076.887545:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023488 00000100:00100000:2.0:1788620076.887599:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788620076.887608:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677023488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620076.887891:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677023488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620076.887899:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788620076.888566:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620076.888615:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620076.888664:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620076.888688:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620076.888816:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023616 00000100:00100000:1.0:1788620076.888822:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023616 00000100:00100000:1.0:1788620076.888853:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788620076.888860:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677023616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620076.889006:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:14476:x1875503677023616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620076.889012:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788620076.889493:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:937205a0-294a-4965-a8b3-aa80c7ce7507:14476:1875503677023616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620076.892028:0:16649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788620076.892254:0:14476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788620076.892277:0:14476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788620076.892287:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620076.892298:0:14476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620076.958261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620076.958567:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106560 00000100:00100000:2.0:1788620076.958579:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106560 00000100:00100000:2.0:1788620076.958640:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788620076.958650:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:13802:x1875503657106560:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620076.958666:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620076.958683:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc142a00/0xbb0e330328bbf504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad53 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.958710:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142a00/0xbb0e330328bbf504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad53 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.958736:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc142a00/0xbb0e330328bbf504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad53 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620076.958744:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142a00, rc 0) 00000100:00100000:2.0:1788620076.958817:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106560:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 168us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620076.958825:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1788620076.968864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620076.969672:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106688 00000100:00100000:2.0:1788620076.969683:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106688 00000100:00100000:2.0:1788620076.969752:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1788620076.969764:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106688:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620076.970123:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106688:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 361us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620076.970132:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788620076.973198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620076.978507:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106816 00000100:00100000:2.0:1788620076.978524:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106816 00000100:00100000:2.0:1788620076.978587:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1788620076.978597:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106816:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620076.978839:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106816:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 241us (5649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620076.978848:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788620076.986212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620076.992448:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657106944 00000100:00100000:1.0:1788620076.992463:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657106944 00000100:00100000:0.0:1788620076.994526:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788620076.994539:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:13802:x1875503657106944:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620076.994555:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620076.994574:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf50b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad5a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620076.994606:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad5a expref: 13 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620076.994618:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad5a expref: 13 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620076.996743:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3a00, rc 0) 00000100:00100000:0.0:1788620076.996855:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13802:x1875503657106944:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 2314us (10648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620076.996864:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1788620077.001705:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620077.005891:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107072 00000100:00100000:2.0:1788620077.005907:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107072 00000100:00100000:2.0:1788620077.005977:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788620077.005988:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13802:x1875503657107072:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620077.006356:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13802:x1875503657107072:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 368us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620077.006365:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788620077.009863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620077.009915:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107200 00000100:00100000:2.0:1788620077.009925:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107200 00000100:00100000:2.0:1788620077.009976:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1788620077.009986:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13802:x1875503657107200:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620077.010207:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:13802:x1875503657107200:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 220us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620077.010216:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00010000:00010000:0.0:1788620077.191582:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620078.215928:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620079.090399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.090638:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107328 00000100:00100000:2.0:1788620079.090649:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107328 00000100:00100000:2.0:1788620079.090869:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788620079.090881:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:14460:x1875503657107328:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620079.090903:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.090930:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad61 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091002:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091018:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091032:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091067:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091074:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091081:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091439:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091449:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.091457:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620079.091497:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788620079.091501:0:14481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1788620079.092122:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788620079.092430:0:14481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092446:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092452:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092458:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092475:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.092480:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092487:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092501:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:2.0:1788620079.092504:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.092509:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092515:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092530:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092546:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092551:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092556:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.092558:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092563:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092581:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff933390117000) 00010000:00010000:2.0:1788620079.092583:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.092586:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092591:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092634:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad61 expref: 8 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092649:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad61 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.092657:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933390117e00) 00010000:00010000:2.0:1788620079.092659:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620079.092661:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143e00, rc 0) 00000100:00100000:2.0:1788620079.092744:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:14460:x1875503657107328:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1864us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.092753:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788620079.099813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620079.100190:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107584 00000100:00100000:3.0:1788620079.100201:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107584 00000100:00100000:3.0:1788620079.100344:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788620079.100355:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:14460:x1875503657107584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620079.100390:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620079.100415:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf52e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad68 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100526:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100540:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100552:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100591:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100599:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100605:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100966:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31800/0xbb0e330328bbf543 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100974:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31800/0xbb0e330328bbf543 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.100980:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31800/0xbb0e330328bbf543 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620079.100988:0:14480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788620079.101248:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101273:0:14480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101279:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101284:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.101289:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101303:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101315:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933390117e00) 00010000:00010000:3.0:1788620079.101318:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.101323:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101336:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf535 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101350:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101357:0:14480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101377:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101382:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.101391:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101397:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101405:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff933388291400) 00010000:00010000:3.0:1788620079.101408:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.101411:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101417:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf53c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101917:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf52e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad68 expref: 10 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101931:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31800/0xbb0e330328bbf543 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad68 expref: 9 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.101938:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933388291e00) 00010000:00010000:3.0:1788620079.101940:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.101942:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31800, rc 0) 00000100:00100000:3.0:1788620079.102004:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14460:x1875503657107584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1651us (2236us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788620079.102011:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788620079.106875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.107911:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107712 00000100:00100000:0.0:1788620079.107928:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107712 00000100:00100000:0.0:1788620079.108004:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788620079.108014:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14460:x1875503657107712:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788620079.108486:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14460:x1875503657107712:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 472us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.108494:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788620079.161240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.161640:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107840 00000100:00100000:2.0:1788620079.161651:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107840 00000100:00100000:2.0:1788620079.161718:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620079.161855:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14466:x1875503657107840:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620079.161875:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.161895:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad6f expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164513:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164656:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164670:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164689:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164697:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.164705:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165464:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165474:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165481:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165487:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.165492:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165510:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165810:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:2.0:1788620079.165815:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.165820:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165827:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165839:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165844:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165849:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165854:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.165857:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165864:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165872:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933390117000) 00010000:00010000:2.0:1788620079.165874:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.165877:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.165894:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf55f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.166404:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf551 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad6f expref: 10 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.166417:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:2.0:1788620079.166420:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.166424:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad6f expref: 10 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.166434:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143000, rc 0) 00000100:00100000:2.0:1788620079.166639:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14466:x1875503657107840:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4789us (5408us total) trans 0 rc 301/301 00000100:00100000:2.0:1788620079.166648:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788620079.181758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.181950:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657107968 00000100:00100000:0.0:1788620079.181960:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657107968 00000100:00100000:0.0:1788620079.182019:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788620079.182030:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14466:x1875503657107968:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:0.0:1788620079.182114:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14466:x1875503657107968:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 86us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.182122:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620079.185460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.185823:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108224 00000100:00100000:2.0:1788620079.185833:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108224 00000100:00100000:2.0:1788620079.185882:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788620079.185892:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14466:x1875503657108224:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:2.0:1788620079.185949:0:14481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620079.185974:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf494 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acea expref: 9 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.185993:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:2.0:1788620079.185998:0:14481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620079.186196:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.186220:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 5 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.186230:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.186265:0:14481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 5 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.186280:0:14481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 5 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620079.186296:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14481:1875503677023744:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620079.186406:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788620079.192009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.192107:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108352 00000100:00100000:0.0:1788620079.192116:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108352 00010000:00010000:0.0:1788620079.192173:0:14466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 6 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620079.192217:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788620079.192234:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657108352:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620079.192251:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620079.192259:0:14466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 6 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.192273:0:14466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 6 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.192297:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620079.192303:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.192313:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.192321:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.192340:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620079.192407:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657108352:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.192415:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00010000:00010000:2.0:1788620079.192427:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf4cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad4c expref: 6 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620079.192448:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc454e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14481:1875503677023744:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620079.192473:0:14481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.192483:0:14481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.192490:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.192513:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.192530:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.192539:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788620079.192549:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788620079.195479:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788620079.195500:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195509:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195515:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195521:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.195525:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195533:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195549:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933383b59100) 00010000:00010000:2.0:1788620079.195552:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.195556:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.195562:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf566 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620079.195596:0:14481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a1a572 reply state 0000000005583006 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620079.195605:0:14481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620079.195866:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+10:14466:x1875503657108224:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 9970us (10410us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788620079.195875:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:3.0:1788620079.200644:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200676:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200684:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200690:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.200694:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200702:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200719:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933390117000) 00010000:00010000:3.0:1788620079.200722:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.200727:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.200734:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf56d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620079.239713:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620079.303167:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677024256:0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.303226:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024128:0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.303240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620079.303347:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677023872:0@lo:400:kworker.0 00000100:00100000:1.0:1788620079.303409:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677024000:0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.304122:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620079.304256:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620079.304300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620079.304335:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024256 00000100:00100000:2.0:1788620079.304341:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024256 00000100:00100000:2.0:1788620079.304403:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620079.304413:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.304461:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677024256:12345-0@lo:400:kworker.0 Request processed in 50us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.304468:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620079.304503:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024128 00000100:00100000:2.0:1788620079.304506:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024128 00000100:00100000:2.0:1788620079.304540:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620079.304546:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.304581:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024128:12345-0@lo:400:kworker.0 Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.304587:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620079.304626:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024128:0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.304678:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024640 00000100:00100000:2.0:1788620079.304682:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024640 00000100:00100000:2.0:1788620079.304709:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620079.304715:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620079.304761:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620079.304823:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.304829:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620079.304860:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788620079.304883:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620079.304887:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620079.304932:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620079.304956:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677024256:0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.305245:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620079.305602:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620079.307716:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620079.307895:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677024384:0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.308002:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024768 00000100:00100000:0.0:1788620079.308011:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024768 00000100:00100000:3.0:1788620079.308065:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620079.308074:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620079.308086:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620079.308110:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677023872 00000100:00100000:3.0:1788620079.308115:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677023872 00002000:00000024:0.0:1788620079.308124:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620079.308154:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788620079.308163:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.308184:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677024768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.308192:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620079.308215:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677023872:12345-0@lo:400:kworker.0 Request processed in 53us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.308221:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024384 00000100:00100000:3.0:1788620079.308225:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788620079.308228:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024384 00000100:00100000:3.0:1788620079.308268:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677023872:0@lo:400:kworker.0 00000100:00100000:3.0:1788620079.308330:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677024768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620079.308496:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620079.308502:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677024384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.308540:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677024384:12345-0@lo:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.308546:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620079.308644:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620079.308678:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677024512:0@lo:400:kworker.0 00000100:00100000:1.0:1788620079.308702:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620079.308730:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024512 00000100:00100000:1.0:1788620079.308734:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024512 00000100:00100000:1.0:1788620079.308980:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620079.308988:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677024512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620079.309026:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677024512:12345-0@lo:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.309033:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620079.309062:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677024512:0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.309322:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677024000 00000100:00100000:0.0:1788620079.309326:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677024000 00000100:00100000:0.0:1788620079.309360:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620079.309377:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.309421:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677024000:12345-0@lo:400:kworker.0 Request processed in 55us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.309427:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788620079.310688:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620079.310745:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677024384:0@lo:400:kworker.0 00000100:00100000:2.0:1788620079.310857:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677024000:0@lo:400:kworker.0 00000100:00100000:0.0:1788620079.339839:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.339997:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108480 00000100:00100000:2.0:1788620079.340008:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108480 00000100:00100000:2.0:1788620079.340065:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788620079.340075:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:14474:x1875503657108480:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:2.0:1788620079.340095:0:16239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.340118:0:16239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad76 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340185:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340201:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340228:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620079.340264:0:16239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788620079.340269:0:16239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620079.340303:0:16239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340329:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad76 expref: 11 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340347:0:16239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad76 expref: 10 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.340355:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:2.0:1788620079.340358:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620079.340362:0:16239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142600, rc 0) 00000100:00100000:2.0:1788620079.340424:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+10:14474:x1875503657108480:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 350us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.340431:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788620079.391160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.393380:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108608 00000100:00100000:1.0:1788620079.393395:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108608 00000100:00100000:1.0:1788620079.393538:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788620079.393550:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:14475:x1875503657108608:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788620079.393581:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620079.393602:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbf582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad7d expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393668:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393689:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393702:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620079.393766:0:14480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788620079.393787:0:14480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620079.393811:0:14480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393837:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbf582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad7d expref: 7 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393856:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad7d expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.393864:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:1.0:1788620079.393867:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620079.393871:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:1.0:1788620079.393942:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:14475:x1875503657108608:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 394us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.393949:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788620079.401171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.401257:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108736 00000100:00100000:2.0:1788620079.401267:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108736 00000100:00100000:2.0:1788620079.401331:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788620079.401341:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:14475:x1875503657108736:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620079.401361:0:16239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.401500:0:16239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad84 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401595:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401611:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401624:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401639:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401645:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401652:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401816:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401825:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401831:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620079.401863:0:16239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788620079.401867:0:16239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620079.401885:0:16239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401908:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401914:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401921:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401926:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.401931:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401938:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401950:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:2.0:1788620079.401953:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.401958:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401963:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143a00/0xbb0e330328bbf597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401975:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401980:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401985:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.401996:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.402011:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402019:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402028:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933390117b00) 00010000:00010000:2.0:1788620079.402030:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620079.402033:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402040:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf59e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402074:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad84 expref: 8 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402089:0:16239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad84 expref: 7 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.402096:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:2.0:1788620079.402098:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620079.402101:0:16239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142000, rc 0) 00000100:00100000:2.0:1788620079.402164:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+7:14475:x1875503657108736:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 824us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.402171:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788620079.408809:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.408896:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657108992 00000100:00100000:2.0:1788620079.408919:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657108992 00000100:00100000:2.0:1788620079.408978:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788620079.408989:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+7:14475:x1875503657108992:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620079.409009:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.409029:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf5ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad8b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620079.409126:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788620079.409257:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf5ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad8b expref: 9 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.409272:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:2.0:1788620079.409275:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620079.409279:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbf5ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad8b expref: 9 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.409292:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143000, rc 0) 00000100:00100000:2.0:1788620079.409351:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+8:14475:x1875503657108992:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 364us (579us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788620079.409357:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788620079.415198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.416173:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657109248 00000100:00100000:2.0:1788620079.416188:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657109248 00000100:00100000:2.0:1788620079.416273:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788620079.416286:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+8:14475:x1875503657109248:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:2.0:1788620079.416346:0:16239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620079.416382:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142000/0xbb0e330328bbf5a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad84 expref: 8 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.416430:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933390117000) 00010000:00010000:2.0:1788620079.416440:0:16239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620079.416464:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.416485:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.416495:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620079.416972:0:16239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ac6a1b6 reply state 000000000c0325a3 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620079.416982:0:16239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788620079.416989:0:16239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788620079.417148:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa1a06f-2672-4b8a-a479-ea28f38363d8+9:14475:x1875503657109248:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 865us (1964us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788620079.417155:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:2.0:1788620079.419388:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419413:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419421:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419428:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620079.419432:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419453:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419646:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933390117b00) 00010000:00010000:2.0:1788620079.419651:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788620079.419658:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.419664:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf5ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620079.423982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.424131:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657109504 00000100:00100000:0.0:1788620079.424140:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657109504 00000100:00100000:0.0:1788620079.424197:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788620079.424206:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+8:14475:x1875503657109504:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788620079.425129:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+9:14475:x1875503657109504:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 917us (1151us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788620079.425138:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788620079.428121:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.428863:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657109760 00000100:00100000:2.0:1788620079.428875:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657109760 00000100:00100000:3.0:1788620079.429323:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788620079.429334:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+9:14475:x1875503657109760:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788620079.429359:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620079.429391:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad92 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429479:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429494:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429505:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429518:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429525:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.429547:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620079.429664:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788620079.430013:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430023:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430030:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430036:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.430040:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430048:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430059:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:3.0:1788620079.430062:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.430066:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430073:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf5c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430087:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430104:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430110:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430114:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.430117:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430123:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430131:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933388291400) 00010000:00010000:3.0:1788620079.430134:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.430136:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430142:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430183:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad92 expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430193:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:3.0:1788620079.430195:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620079.430198:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad92 expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.430218:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31a00, rc 0) 00000100:00100000:3.0:1788620079.430393:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+10:14475:x1875503657109760:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1059us (2280us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788620079.430400:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788620079.434571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.434696:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657109888 00000100:00100000:1.0:1788620079.434706:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657109888 00000100:00100000:1.0:1788620079.434800:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788620079.434810:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+10:14475:x1875503657109888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788620079.434831:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620079.434852:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf5dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ad99 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.434966:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.434979:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.434992:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620079.435015:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788620079.435018:0:14481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620079.435034:0:14481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.435058:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf5dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.435075:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.435084:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:1.0:1788620079.435087:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620079.435090:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce400, rc 0) 00000100:00100000:1.0:1788620079.435143:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+11:14475:x1875503657109888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 335us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.435149:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788620079.440084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.440177:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110016 00000100:00100000:2.0:1788620079.440188:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110016 00000100:00100000:2.0:1788620079.440244:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788620079.440253:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+11:14475:x1875503657110016:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1788620079.452262:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+11:14475:x1875503657110016:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 11998us (12177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.452274:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788620079.464815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620079.464937:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110272 00000100:00100000:3.0:1788620079.464955:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110272 00000100:00100000:3.0:1788620079.465041:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620079.465056:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933284d33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+11:14475:x1875503657110272:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788620079.465416:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933284d33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+12:14475:x1875503657110272:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 363us (649us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788620079.465425:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788620079.522542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.522597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.522632:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.522665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.522696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620079.522729:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110656 00000100:00100000:0.0:1788620079.522740:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110656 00000100:00100000:3.0:1788620079.522884:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110912 00000100:00100000:3.0:1788620079.522888:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110912 00000100:00100000:3.0:1788620079.522931:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110528 00000100:00100000:3.0:1788620079.522933:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110528 00000100:00100000:3.0:1788620079.522944:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110784 00000100:00100000:3.0:1788620079.522946:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110784 00000100:00100000:3.0:1788620079.522960:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620079.522969:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2356:x1875503657110912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620079.523053:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2356:x1875503657110912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620079.523061:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620079.523081:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788620079.523086:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2356:x1875503657110528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620079.523134:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2356:x1875503657110528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620079.523143:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788620079.523156:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620079.523163:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2356:x1875503657110784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620079.523185:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2356:x1875503657110784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620079.523191:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788620079.523313:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788620079.523322:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2356:x1875503657110656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620079.523349:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2356:x1875503657110656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620079.523355:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788620079.523639:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657110400 00000100:00100000:2.0:1788620079.523646:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657110400 00000100:00100000:2.0:1788620079.523683:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1788620079.523692:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2356:x1875503657110400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620079.523722:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2356:x1875503657110400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.523742:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00080000:2.0:1788620079.523841:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620079.523847:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620079.537991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620079.538165:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657111040 00000100:00100000:3.0:1788620079.538178:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657111040 00000100:00100000:3.0:1788620079.538250:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788620079.538261:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+10:14481:x1875503657111040:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788620079.538289:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620079.538315:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ada0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538427:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538445:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538458:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538474:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538690:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538698:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538871:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538880:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538887:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620079.538921:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788620079.538925:0:14479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620079.538973:0:14479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.538988:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539008:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539015:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539021:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.539027:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539045:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539060:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:3.0:1788620079.539064:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.539069:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539075:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf5f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539092:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539097:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539103:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539109:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.539111:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539117:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539123:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933388291400) 00010000:00010000:3.0:1788620079.539126:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.539129:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539143:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf5f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539182:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada0 expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539197:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada0 expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.539204:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:3.0:1788620079.539206:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788620079.539209:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30c00, rc 0) 00000100:00100000:3.0:1788620079.539286:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+11:14481:x1875503657111040:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1026us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620079.539294:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788620079.544460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.545378:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657111296 00000100:00100000:1.0:1788620079.545395:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657111296 00000100:00100000:1.0:1788620079.545483:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788620079.545630:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+11:14481:x1875503657111296:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788620079.545661:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620079.545692:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbf607 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ada7 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.545908:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.545926:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.545936:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.545984:0:14481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.546000:0:14481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 11 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620079.546016:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14481:1875503677024896:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788620079.546146:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e32480 going to sleep for 11 seconds 00000100:00100000:0.0:1788620079.553303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.553444:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657111424 00000100:00100000:2.0:1788620079.553457:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657111424 00010000:00010000:2.0:1788620079.553518:0:14465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 12 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620079.553567:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788620079.553578:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+12:2355:x1875503657111424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620079.553597:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620079.553605:0:14465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 12 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.553621:0:14465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 12 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.553649:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:2.0:1788620079.553655:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.553666:0:14465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.553676:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.553699:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620079.553825:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+12:2355:x1875503657111424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 247us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620079.553833:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:1.0:1788620079.557140:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce400/0xbb0e330328bbf5e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad99 expref: 11 pid: 14481 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620079.557178:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285999f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14481:1875503677024896:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788620079.557233:0:14481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.557246:0:14481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.557253:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.557434:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.557459:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.557482:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559050:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559067:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559079:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620079.559091:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788620079.559122:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559130:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559150:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559156:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620079.559160:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559168:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559181:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:1.0:1788620079.559185:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620079.559189:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559195:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbf60e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620079.559210:0:14481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049fcaa53 reply state 00000000b2fa1074 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620079.559219:0:14481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788620079.559268:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbf607 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 14 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559284:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 13 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.559292:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620079.559301:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788620079.559304:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0200, rc 0) 00000100:00100000:1.0:1788620079.559392:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14481:x1875503657111296:12345-192.168.203.12@tcp:101:bash.0 Request processed in 13768us (14951us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788620079.559410:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:3.0:1788620079.561812:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561829:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561837:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561844:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620079.561848:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561873:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561887:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff933383b59400) 00010000:00010000:3.0:1788620079.561890:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620079.561895:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.561911:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf615 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620079.591020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.591435:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657111552 00000100:00100000:1.0:1788620079.591447:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657111552 00000100:00100000:1.0:1788620079.591520:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788620079.591531:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:14481:x1875503657111552:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788620079.591557:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620079.591580:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf62a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adae expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591660:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591675:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591688:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620079.591727:0:14480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788620079.591731:0:14480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620079.591766:0:14480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591828:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591863:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf62a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 15 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591898:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 14 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.591907:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620079.591910:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620079.591915:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:1.0:1788620079.591976:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14481:x1875503657111552:12345-192.168.203.12@tcp:101:bash.0 Request processed in 448us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.591984:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788620079.596872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.596960:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657111808 00000100:00100000:2.0:1788620079.596971:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657111808 00000100:00100000:2.0:1788620079.597030:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788620079.597041:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14481:x1875503657111808:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788620079.597630:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+15:14481:x1875503657111808:12345-192.168.203.12@tcp:35:bash.0 Request processed in 589us (766us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788620079.597638:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000040:00080000:2.0:1788620079.624554:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788620079.708506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.708805:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657112064 00000100:00100000:2.0:1788620079.708815:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657112064 00000100:00100000:2.0:1788620079.708881:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788620079.708891:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+15:14491:x1875503657112064:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620079.708914:0:16239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620079.708934:0:16239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adb5 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620079.709025:0:16239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788620079.709135:0:16239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf638 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adb5 expref: 17 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.709148:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:2.0:1788620079.709151:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620079.709156:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbf638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adb5 expref: 17 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620079.709185:0:16239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142800, rc 0) 00000100:00100000:2.0:1788620079.709243:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+16:14491:x1875503657112064:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 353us (746us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788620079.709250:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788620079.713011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620079.714044:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657112320 00000100:00100000:2.0:1788620079.714056:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657112320 00000100:00100000:2.0:1788620079.714158:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620079.714170:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+16:14491:x1875503657112320:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788620079.714405:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+17:14491:x1875503657112320:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 236us (1406us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788620079.714421:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788620079.764647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620079.764847:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657112576 00000100:00100000:3.0:1788620079.764857:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657112576 00000100:00100000:3.0:1788620079.764918:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788620079.764929:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+17:14494:x1875503657112576:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788620079.764952:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620079.764976:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf646 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adbc expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.765070:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf64d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.765084:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf64d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.765098:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf64d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620079.765128:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620079.765252:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf646 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adbc expref: 20 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.765272:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf64d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adbc expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620079.765280:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620079.765283:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620079.765286:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30e00, rc 0) 00000100:00100000:3.0:1788620079.765461:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14494:x1875503657112576:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 534us (824us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788620079.765468:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788620079.772885:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.773312:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657112704 00000100:00100000:1.0:1788620079.773322:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657112704 00000100:00100000:1.0:1788620079.773385:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788620079.773393:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14494:x1875503657112704:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788620079.773531:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773547:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773558:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773582:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773588:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773606:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773612:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620079.773617:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773624:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773635:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620079.773638:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788620079.773643:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.773649:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf65b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620079.773723:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14494:x1875503657112704:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 323us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.774011:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788620079.776041:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.776301:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657112832 00000100:00100000:1.0:1788620079.776312:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657112832 00000100:00100000:1.0:1788620079.776384:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620079.776394:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:2355:x1875503657112832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620079.776410:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620079.776668:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf64d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adbc expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620079.776703:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620079.776708:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620079.777049:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+18:2355:x1875503657112832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 654us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620079.777058:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788620079.785607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620079.785695:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657113088 00000100:00100000:1.0:1788620079.785706:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657113088 00000100:00100000:1.0:1788620079.785763:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788620079.785795:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+18:14494:x1875503657113088:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788620079.786051:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14494:x1875503657113088:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 278us (453us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788620079.786058:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620080.133731:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.134010:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657113344 00000100:00100000:1.0:1788620080.134021:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657113344 00000100:00100000:1.0:1788620080.134086:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788620080.134097:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14525:x1875503657113344:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788620080.134121:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.134143:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf662 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adc3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.134240:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf669 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.134254:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.134285:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620080.134296:0:14480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788620080.134445:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf662 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adc3 expref: 22 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.134464:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf669 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adc3 expref: 21 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.134473:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620080.134476:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620080.134480:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1200, rc 0) 00000100:00100000:1.0:1788620080.134542:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:14525:x1875503657113344:12345-192.168.203.12@tcp:101:cat.0 Request processed in 447us (821us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788620080.134549:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788620080.140260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620080.140369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.140844:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657113472 00000100:00100000:0.0:1788620080.140855:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657113472 00000100:00100000:0.0:1788620080.140933:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788620080.140945:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:2354:x1875503657113472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620080.140972:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620080.141000:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf669 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adc3 expref: 21 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.141024:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620080.141030:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620080.141096:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+20:2354:x1875503657113472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 152us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620080.141105:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788620080.144375:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657113728 00000100:00100000:1.0:1788620080.144391:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657113728 00000100:00100000:1.0:1788620080.144534:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620080.144545:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+20:14525:x1875503657113728:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788620080.147300:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:14525:x1875503657113728:12345-192.168.203.12@tcp:35:cat.0 Request processed in 2745us (6928us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788620080.147313:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788620080.231159:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.231259:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657113984 00000100:00100000:0.0:1788620080.231270:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657113984 00000100:00100000:0.0:1788620080.231337:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788620080.231347:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:14531:x1875503657113984:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788620080.231383:0:16239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620080.231405:0:16239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf677 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adca expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231519:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231533:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231547:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 22 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231555:0:16239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231601:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 22 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231615:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 22 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.231628:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025024:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620080.231731:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.231741:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.231750:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025152:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620080.231809:0:16239:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620080.236310:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025024:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620080.236324:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025152:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620080.236350:0:16239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620080.237854:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620080.237948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.238182:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657114112 00000100:00100000:3.0:1788620080.238191:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657114112 00010000:00010000:3.0:1788620080.238228:0:14465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 23 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620080.238267:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657114240 00000100:00100000:3.0:1788620080.238271:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657114240 00010000:00010000:3.0:1788620080.238284:0:14465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 24 pid: 14481 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620080.238301:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788620080.238310:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bafb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:2355:x1875503657114112:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620080.238324:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620080.238344:0:14465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 24 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238357:0:14465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 24 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238394:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf631 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adae expref: 24 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238412:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.238418:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238437:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238445:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620080.238510:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bafb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:2355:x1875503657114112:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 200us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.238517:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788620080.238565:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620080.238572:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+22:2355:x1875503657114240:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620080.238581:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620080.238586:0:14465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238596:0:14465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238620:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf61c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada7 expref: 22 pid: 14481 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238630:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.238633:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238641:0:14465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238648:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238672:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620080.238694:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:2355:x1875503657114240:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 123us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.238701:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:3.0:1788620080.238725:0:16239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.238733:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620080.238752:0:16239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620080.239261:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf677 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adca expref: 22 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.239279:0:16239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adca expref: 21 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.239297:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.239300:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788620080.239303:0:16239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2600, rc 0) 00000100:00100000:3.0:1788620080.239333:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:14531:x1875503657113984:12345-192.168.203.12@tcp:101:dd.0 Request processed in 7988us (8186us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788620080.239340:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788620080.248267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.248354:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657114496 00000100:00100000:1.0:1788620080.248372:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657114496 00000100:00100000:1.0:1788620080.248434:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788620080.248445:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+21:14531:x1875503657114496:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1788620080.248719:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.248737:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.248759:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620080.248837:0:14480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788620080.248862:0:14480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8992ae4 reply state 000000007421ac9e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.248870:0:14480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788620080.249135:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14531:x1875503657114496:12345-192.168.203.12@tcp:36:dd.0 Request processed in 691us (877us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788620080.249144:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000020:00080000:1.0:1788620080.249148:0:14480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620080.251166:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251184:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251191:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251198:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620080.251203:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251212:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251230:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.251233:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620080.251238:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.251243:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf68c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.253260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.257004:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657114624 00000100:00100000:1.0:1788620080.257020:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657114624 00000100:00100000:1.0:1788620080.257092:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788620080.257104:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:14531:x1875503657114624:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1788620080.257130:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.257153:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf693 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06add1 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.257216:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add1 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.257231:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add1 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.257267:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620080.257271:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620080.257275:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0a00, rc 0) 00000100:00100000:1.0:1788620080.257340:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14531:x1875503657114624:12345-192.168.203.12@tcp:101:dd.0 Request processed in 238us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.257348:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:0.0:1788620080.263795:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620080.276026:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.276156:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657114880 00000100:00100000:3.0:1788620080.276166:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657114880 00000100:00100000:3.0:1788620080.276234:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788620080.276245:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14531:x1875503657114880:12345-192.168.203.12@tcp:103:dd.0 00010000:00010000:3.0:1788620080.276262:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620080.276286:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0a00/0xbb0e330328bbf693 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add1 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.276306:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.276312:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620080.276379:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:14531:x1875503657114880:12345-192.168.203.12@tcp:103:dd.0 Request processed in 136us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.276386:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788620080.285954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.286281:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115008 00000100:00100000:3.0:1788620080.286292:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115008 00000100:00100000:3.0:1788620080.286346:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788620080.286357:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:14531:x1875503657115008:12345-192.168.203.12@tcp:58:dd.0 00010000:00010000:3.0:1788620080.286484:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.286503:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.286516:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620080.287453:0:14479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620080.287608:0:14479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788620080.287681:0:14479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788620080.287817:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:14531:x1875503657115008:12345-192.168.203.12@tcp:58:dd.0 Request processed in 1459us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.287826:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788620080.293490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.293586:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115136 00000100:00100000:0.0:1788620080.293597:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115136 00000100:00100000:0.0:1788620080.293658:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788620080.293669:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+23:14531:x1875503657115136:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788620080.293688:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620080.293715:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06add8 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293833:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293845:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293869:0:14481:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293884:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293897:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620080.293905:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620080.293909:0:14481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 24 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.293918:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:0.0:1788620080.293976:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14531:x1875503657115136:12345-192.168.203.12@tcp:101:dd.0 Request processed in 308us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620080.293983:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000040:00080000:2.0:1788620080.650396:0:14513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620080.650405:0:14513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620080.650439:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788620080.650446:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788620080.650558:0:14513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc456680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14513:1875503677025280:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788620080.650672:0:14513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620080.662152:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620080.662339:0:14513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc456680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14513:1875503677025280:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788620080.662347:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115264 00000100:00100000:3.0:1788620080.662367:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115264 00000100:00100000:3.0:1788620080.662427:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788620080.662437:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115264:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788620080.662522:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115264:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 75us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.662531:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788620080.665284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.665389:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115392 00000100:00100000:1.0:1788620080.665399:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115392 00000100:00100000:1.0:1788620080.665461:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788620080.665471:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115392:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788620080.665501:0:14479:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788620080.665624:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115392:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.665631:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788620080.673224:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.673670:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115520 00000100:00100000:1.0:1788620080.673680:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115520 00000100:00100000:1.0:1788620080.673744:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788620080.673755:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115520:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788620080.673866:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.673882:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.673920:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.673985:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.673993:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674001:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674023:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674031:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674038:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620080.674073:0:14481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788620080.674076:0:14481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620080.674089:0:14481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674099:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674105:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674122:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674128:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620080.674132:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674139:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674150:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933388291e00) 00010000:00010000:1.0:1788620080.674154:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620080.674158:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674166:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674178:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674184:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674190:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674196:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620080.674199:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674212:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674219:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff933383b59b00) 00010000:00010000:1.0:1788620080.674222:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620080.674224:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674230:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674244:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674250:0:14481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674467:0:14481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674475:0:14481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620080.674478:0:14481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674485:0:14481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674493:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:1.0:1788620080.674496:0:14481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620080.674499:0:14481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.674525:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0200/0xbb0e330328bbf6b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.676169:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115520:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 2406us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.676183:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788620080.685454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.685598:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115776 00000100:00100000:3.0:1788620080.685608:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115776 00000100:00100000:3.0:1788620080.685660:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788620080.685670:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+24:14532:x1875503657115776:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620080.685689:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620080.685712:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06addf expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.685870:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.685886:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.685905:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620080.685924:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620080.686022:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686030:0:14479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686038:0:14479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686044:0:14479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620080.686048:0:14479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686056:0:14479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686068:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:3.0:1788620080.686071:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620080.686076:0:14479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686082:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686121:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06addf expref: 26 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686130:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933388291e00) 00010000:00010000:3.0:1788620080.686133:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620080.686142:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06addf expref: 26 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.686152:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b31a00, rc 0) 00000100:00100000:3.0:1788620080.686208:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+25:14532:x1875503657115776:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 540us (764us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788620080.686216:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788620080.699436:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.699526:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657115904 00000100:00100000:3.0:1788620080.699536:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657115904 00000100:00100000:3.0:1788620080.699593:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788620080.699603:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+25:14532:x1875503657115904:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620080.699638:0:16239:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620080.699747:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+25:14532:x1875503657115904:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.699754:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788620080.709742:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.711495:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657116160 00000100:00100000:3.0:1788620080.711876:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657116160 00000100:00100000:3.0:1788620080.711978:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788620080.711993:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+25:14532:x1875503657116160:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620080.712031:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620080.712061:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ade6 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788620080.716114:0:14479:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788620080.716136:0:14479:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788620080.716204:0:14479:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788620080.719570:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.719608:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.719622:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.719728:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ade6 expref: 28 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.719752:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ade6 expref: 27 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.719761:0:14479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788620080.719765:0:14479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620080.719768:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333b8b30e00, rc 0) 00000100:00100000:3.0:1788620080.719891:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+27:14532:x1875503657116160:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 7901us (10183us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788620080.719900:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788620080.727820:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.728852:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657116416 00000100:00100000:3.0:1788620080.728868:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657116416 00000100:00100000:3.0:1788620080.728964:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788620080.728978:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+27:14532:x1875503657116416:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620080.729068:0:16239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620080.729104:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30e00/0xbb0e330328bbf6d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ade6 expref: 27 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729130:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933388291400) 00010000:00010000:3.0:1788620080.729159:0:16239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620080.729190:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729207:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729220:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729256:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729264:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729272:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729354:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729373:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729381:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729387:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620080.729392:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729400:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729415:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:3.0:1788620080.729418:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620080.729422:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.729883:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31a00/0xbb0e330328bbf6e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730219:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730227:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730234:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730240:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620080.730244:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730251:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730262:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfb2dac42 (ffff933388291d00) 00010000:00010000:3.0:1788620080.730265:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620080.730269:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.730274:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf6ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfb2dac42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620080.731875:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+26:14532:x1875503657116416:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 2883us (4097us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620080.731891:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788620080.733712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.733862:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657116544 00000100:00100000:1.0:1788620080.733877:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657116544 00000100:00100000:1.0:1788620080.733946:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788620080.733956:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+26:14532:x1875503657116544:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620080.733975:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.734000:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aded expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734038:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734052:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734066:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734175:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf6f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aded expref: 28 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734207:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aded expref: 27 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.734216:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:1.0:1788620080.734218:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788620080.734221:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:1.0:1788620080.734291:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+27:14532:x1875503657116544:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 336us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.734298:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788620080.745550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.746082:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657116800 00000100:00100000:0.0:1788620080.746096:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657116800 00000100:00100000:0.0:1788620080.746373:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788620080.746391:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+27:14532:x1875503657116800:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620080.746527:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.746549:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.746563:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620080.747153:0:14481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788620080.747167:0:14481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 483715394105ns, next at 484715391488ns, rc = 0 00000004:00010000:0.0:1788620080.747275:0:14481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d457aff5 reply state 00000000430f2af7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.747286:0:14481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620080.747444:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+29:14532:x1875503657116800:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1057us (1906us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788620080.747453:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:3.0:1788620080.756093:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.756118:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.756130:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.756132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788620080.756142:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620080.756149:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.756159:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.756182:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:3.0:1788620080.756186:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620080.756192:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620080.756200:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbf703 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.757133:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657116928 00000100:00100000:1.0:1788620080.757149:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657116928 00000100:00100000:1.0:1788620080.757238:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788620080.757250:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+28:14532:x1875503657116928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620080.757291:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.757315:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adf4 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.757400:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 29 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.757417:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 29 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.757439:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:1.0:1788620080.757461:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620080.757465:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1200, rc 0) 00000100:00100000:1.0:1788620080.757550:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+29:14532:x1875503657116928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 302us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.757557:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788620080.765445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.765826:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657117056 00000100:00100000:3.0:1788620080.765840:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657117056 00000100:00100000:3.0:1788620080.765947:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620080.765961:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657117056:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788620080.767596:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2355:x1875503657117056:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 1625us (2162us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788620080.767610:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788620080.785673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.785801:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657117312 00000100:00100000:3.0:1788620080.785810:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657117312 00000100:00100000:3.0:1788620080.785863:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788620080.785874:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+29:14532:x1875503657117312:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788620080.786125:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+30:14532:x1875503657117312:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 251us (458us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788620080.786133:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788620080.793837:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620080.794497:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657117568 00000100:00100000:3.0:1788620080.794523:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657117568 00000100:00100000:3.0:1788620080.794587:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1788620080.794598:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+30:14532:x1875503657117568:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788620080.794724:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+30:14532:x1875503657117568:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 127us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620080.794733:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788620080.800452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.800764:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657117696 00000100:00100000:0.0:1788620080.800840:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657117696 00000100:00100000:0.0:1788620080.800928:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788620080.800941:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+30:14532:x1875503657117696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620080.800969:0:16239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620080.800997:0:16239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf711 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06adfb expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.801096:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.801135:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.801150:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620080.801315:0:16239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620080.801343:0:16239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.801488:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf711 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adfb expref: 32 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.802287:0:16239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adfb expref: 31 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.802302:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:0.0:1788620080.802307:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788620080.802311:0:16239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3400, rc 0) 00000100:00100000:0.0:1788620080.802460:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+31:14532:x1875503657117696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1520us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620080.802470:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788620080.816432:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.820390:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657117824 00000100:00100000:1.0:1788620080.820405:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657117824 00000100:00100000:1.0:1788620080.820506:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620080.820526:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2354:x1875503657117824:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620080.820545:0:15166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.820566:0:15166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae02 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620080.820592:0:15166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2d31, blocks: 0x1 00010000:00010000:1.0:1788620080.820611:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1788620080.820616:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620080.820626:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 7 pid: 15166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.820645:0:15166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 7 pid: 15166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.820660:0:15166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0a00, rc 0) 00000100:00100000:1.0:1788620080.820732:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2354:x1875503657117824:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 208us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.820755:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620080.829805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.829937:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118080 00000100:00100000:0.0:1788620080.829946:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118080 00000100:00100000:0.0:1788620080.830005:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788620080.830016:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+31:14532:x1875503657118080:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788620080.830124:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+31:14532:x1875503657118080:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620080.830145:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788620080.833941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.834132:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118208 00000100:00100000:1.0:1788620080.834142:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118208 00000100:00100000:1.0:1788620080.834211:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788620080.834221:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+31:14532:x1875503657118208:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788620080.888307:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788620080.888320:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788620080.888336:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788620080.888376:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788620080.888392:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788620080.888524:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677025408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788620080.888588:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620080.888674:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677025408 00000100:00100000:1.0:1788620080.888681:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677025408 00000100:00100000:1.0:1788620080.888723:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788620080.888731:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677025408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788620080.888926:0:15945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788620080.888930:0:15945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788620080.888932:0:15945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788620080.888934:0:15945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788620081 -> 1788620081 00002000:00010000:1.0:1788620080.888937:0:15945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788620080.888979:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875503677025408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (390us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788620080.888987:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1788620080.889288:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333c1eda680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788620080.889311:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677025408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788620080.889540:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14532:x1875503657118208:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 55318us (55607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620080.889550:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788620080.901164:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.901504:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118336 00000100:00100000:0.0:1788620080.901523:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118336 00000100:00100000:0.0:1788620080.901579:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788620080.901590:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2355:x1875503657118336:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788620080.902220:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2355:x1875503657118336:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 629us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620080.902229:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788620080.910976:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.912752:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118592 00000100:00100000:0.0:1788620080.912765:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118592 00000100:00100000:0.0:1788620080.912896:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788620080.912907:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14532:x1875503657118592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620080.912961:0:14481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620080.912987:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf718 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adfb expref: 14 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.913005:0:14481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:0.0:1788620080.913010:0:14481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620080.913049:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.913062:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.913070:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620080.913257:0:14481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000957434e6 reply state 0000000053b26c69 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.913266:0:14481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620080.913376:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+15:14532:x1875503657118592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 470us (2410us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788620080.913383:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00010000:00010000:2.0:1788620080.919633:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919650:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919657:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919663:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620080.919682:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919690:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919707:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:2.0:1788620080.919711:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620080.919715:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.919722:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbf726 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620080.937372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.938007:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118720 00000100:00100000:1.0:1788620080.938018:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118720 00000100:00100000:1.0:1788620080.938088:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788620080.938099:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:14532:x1875503657118720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620080.938118:0:15945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620080.938138:0:15945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae09 expref: -99 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.938171:0:15945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.938181:0:15945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620080.938186:0:15945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620080.938192:0:15945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.938228:0:15945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.938243:0:15945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.938257:0:15945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15945:1875503677025536:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788620080.938433:0:15945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333834d0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620080.952060:0:15945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15945:1875503677025536:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788620080.952101:0:15945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.952123:0:15945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0200, rc 0) 00000100:00100000:1.0:1788620080.952194:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+8:14532:x1875503657118720:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 14097us (14841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.952203:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788620080.954141:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620080.958438:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118848 00000100:00100000:1.0:1788620080.958454:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118848 00010000:00010000:1.0:1788620080.958507:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.958559:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788620080.958568:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+8:2354:x1875503657118848:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620080.958583:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620080.958606:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.958631:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.958655:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffd6f75/0xbb0e330328bbf71f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae02 expref: 8 pid: 15166 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.958693:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620080.958697:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620080.958704:0:14464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 7 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.958714:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 7 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620080.958754:0:14464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 7 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620080.958768:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14464:1875503677025664:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788620080.958913:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333834d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620080.969181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.969283:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657118976 00000100:00100000:0.0:1788620080.969293:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657118976 00000100:00100000:0.0:1788620080.969363:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788620080.969374:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+8:2355:x1875503657118976:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788620080.969562:0:15164:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788620080.969565:0:15164:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788620081 00002000:00010000:0.0:1788620080.969568:0:15164:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788620080 00002000:00010000:0.0:1788620080.969570:0:15164:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788620081 -> 1788620081 00002000:00010000:0.0:1788620080.969572:0:15164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788620080.969632:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:2355:x1875503657118976:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 260us (460us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788620080.969640:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788620080.969744:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14464:1875503677025664:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788620080.969766:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620080.969817:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+8:2354:x1875503657118848:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 11250us (15684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620080.969825:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788620080.983879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620080.984026:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657119104 00000100:00100000:2.0:1788620080.984036:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657119104 00000100:00100000:2.0:1788620080.984159:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788620080.984169:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+8:2357:x1875503657119104:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788620080.984851:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.984874:0:15165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.984882:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620080.984954:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788620080.984961:0:15165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.985010:0:15165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620080.985024:0:15165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620080.985038:0:15165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15165:1875503677025792:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620080.985461:0:15165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc0b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620080.999663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620080.999807:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657119232 00000100:00100000:0.0:1788620080.999816:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657119232 00010000:00010000:0.0:1788620080.999859:0:14466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 9 pid: 15945 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620080.999897:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788620080.999907:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:2355:x1875503657119232:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620080.999936:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620080.999959:0:14466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 9 pid: 15945 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.999973:0:14466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 9 pid: 15945 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620080.999998:0:14466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620081.000004:0:14466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620081.000012:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.000021:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.000042:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620081.000101:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:2355:x1875503657119232:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 192us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620081.000112:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:2.0:1788620081.001927:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a7a158/0xbb0e330328bbf72d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae09 expref: 8 pid: 15945 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620081.001949:0:15165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15165:1875503677025792:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620081.001975:0:15165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.001987:0:15165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.001995:0:15165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002025:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002052:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002060:0:15165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002067:0:15165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620081.002071:0:15165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002087:0:15165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002104:0:15165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.002111:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c321fe3/0xbb0e330328bbf734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620081.002195:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2357:x1875503657119104:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 18026us (18325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620081.002370:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788620081.010223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620081.010349:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657119488 00000100:00100000:0.0:1788620081.010369:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657119488 00000100:00100000:0.0:1788620081.010440:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788620081.010450:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:14532:x1875503657119488:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788620081.010521:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010536:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010558:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010819:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010830:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 15 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010838:0:16239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010867:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 15 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.010881:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 15 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.010907:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025920:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620081.010976:0:16239:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e170c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788620081.011037:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620081.017884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620081.018078:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657119616 00000100:00100000:3.0:1788620081.018100:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657119616 00010000:00010000:3.0:1788620081.018141:0:14464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 16 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620081.018200:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788620081.018210:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+16:2355:x1875503657119616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620081.018225:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620081.018232:0:14464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 16 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.018246:0:14464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 16 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.018267:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:3.0:1788620081.018273:0:14464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.018282:0:14464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.018290:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.018309:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620081.018371:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+16:2355:x1875503657119616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 162us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620081.018379:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:0.0:1788620081.019120:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d1200/0xbb0e330328bbf70a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adf4 expref: 15 pid: 14480 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.019141:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677025920:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620081.019162:0:16239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.019173:0:16239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.019190:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620081.019397:0:16239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788620081.019646:0:16239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788620081.019693:0:16239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788620081.020041:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16239:1875503677026048:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788620081.020125:0:16239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620081.020158:0:16239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333836d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788620081.020380:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026048 00000100:00100000:2.0:1788620081.020387:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026048 00000100:00100000:2.0:1788620081.020459:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620081.020468:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16239:x1875503677026048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788620081.020552:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16239:x1875503677026048:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620081.020559:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788620081.020703:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620081.022380:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16239:1875503677026048:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788620081.023082:0:16239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788620081.023159:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16239:1875503677026176:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788620081.023229:0:16239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620081.023256:0:16239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333836d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620081.024540:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026176 00000100:00100000:3.0:1788620081.024556:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026176 00000100:00100000:3.0:1788620081.024610:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620081.024620:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16239:x1875503677026176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788620081.024863:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16239:x1875503677026176:12345-0@lo:1000:mdt00_003.0 Request processed in 244us (1633us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788620081.024871:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620081.025399:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc10f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16239:1875503677026176:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788620081.025445:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025454:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025461:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025466:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620081.025470:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025491:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025573:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:0.0:1788620081.025577:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620081.025582:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025589:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2000/0xbb0e330328bbf742 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025624:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025630:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025636:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025641:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620081.025643:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025648:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025656:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620081.025658:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620081.025664:0:16239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025687:0:16239:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025696:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.025972:0:16239:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.025989:0:16239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677026304:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788620081.026071:0:16239:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620081.032316:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620081.032514:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657119744 00000100:00100000:3.0:1788620081.032523:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657119744 00000100:00100000:3.0:1788620081.032581:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620081.032590:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933284d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14531:x1875503657119744:12345-192.168.203.12@tcp:49:dd.0 00000100:00100000:0.0:1788620081.035879:0:16239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16239:1875503677026304:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788620081.036020:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036032:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30400/0xbb0e330328bbf69a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036071:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036085:0:16239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036098:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036109:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036129:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036135:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036141:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620081.036145:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036152:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036164:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620081.036167:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620081.036170:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036176:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbf749 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036186:0:16239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036267:0:16239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036275:0:16239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036279:0:16239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620081.036288:0:16239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036295:0:16239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036304:0:16239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620081.036306:0:16239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788620081.036310:0:16239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.036316:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbf73b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.036623:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+19:14532:x1875503657119488:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 26172us (26405us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788620081.036633:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000020:00080000:0.0:1788620081.036639:0:16239:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788620081.038987:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933284d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+18:14531:x1875503657119744:12345-192.168.203.12@tcp:49:dd.0 Request processed in 6387us (6670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620081.039001:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000040:00080000:2.0:1788620081.041653:0:14513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620081.041663:0:14513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620081.041695:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788620081.041704:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788620081.046032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620081.047521:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120000 00000100:00100000:3.0:1788620081.047535:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120000 00000100:00100000:3.0:1788620081.047672:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788620081.047682:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+18:14532:x1875503657120000:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788620081.050152:0:14483:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788620081.050256:0:14483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788620081.050309:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050327:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050338:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050369:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050376:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050381:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.050405:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788620081.050561:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+20:14532:x1875503657120000:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 2875us (4534us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788620081.050571:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000020:00080000:3.0:1788620081.050576:0:14483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788620081.050577:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620081.050583:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.050590:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620081.050593:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.050602:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.050615:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:2.0:1788620081.050618:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788620081.050623:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.050629:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93338cca8600/0xbb0e330328bbf750 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.050639:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620081.050641:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620081.050642:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620081.264334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620081.264685:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120128 00000100:00100000:2.0:1788620081.264696:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120128 00000100:00100000:2.0:1788620081.264811:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788620081.264822:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2355:x1875503657120128:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:2.0:1788620081.264869:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c2d31, atime: 0x6a9c2d30, ctime: 0x6a9c2d31, blocks: 0x1 00010000:00010000:2.0:1788620081.264877:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.264907:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1788620081.264912:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620081.264919:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620081.264936:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788620081.267096:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620081.268378:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620081.268423:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620081.268536:0:15171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620081.268547:0:15171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788620081.270440:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120256 00000100:00100000:1.0:1788620081.270452:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120256 00000100:00100000:1.0:1788620081.270515:0:15171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788620081.270525:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120384 00000100:00100000:1.0:1788620081.270528:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120384 00000100:00100000:0.0:1788620081.271064:0:16708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788620081.271077:0:16708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+10:2356:x1875503657120256:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:0.0:1788620081.271112:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.271130:0:16708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.271134:0:16708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.271140:0:16708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.271166:0:16708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.289271:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788620081.421618:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1788620081.421644:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1788620081.421657:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1788620081.421662:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1788620081.421879:0:15169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1788620081.421895:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788620081.421917:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.421934:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.421945:0:15169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.421953:0:15169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620081.421960:0:15169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.421970:0:15169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.421996:0:15169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.422005:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d96f20/0xbb0e330328bbf757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.422201:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+10:2355:x1875503657120128:12345-192.168.203.12@tcp:4:dd.0 Request processed in 157372us (157881us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788620081.422214:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788620081.422257:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788620081.422273:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:2354:x1875503657120384:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:0.0:1788620081.422314:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.422328:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.422334:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.422342:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.422368:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620081.469001:0:16708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1788620081.469013:0:16708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1788620081.469034:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469050:0:16708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469061:0:16708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469078:0:16708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620081.469085:0:16708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469096:0:16708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469132:0:16708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.469167:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbf75e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.469290:0:16708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+11:2356:x1875503657120256:12345-192.168.203.12@tcp:4:dd.0 Request processed in 198208us (200911us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788620081.469301:0:16708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000001:00080000:2.0:1788620081.469551:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1788620081.529679:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1788620081.529706:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529721:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529731:0:15169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529740:0:15169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620081.529757:0:15169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529767:0:15169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529819:0:15169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.529851:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba051c12/0xbb0e330328bbf765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.530164:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2354:x1875503657120384:12345-192.168.203.12@tcp:4:dd.0 Request processed in 107887us (261730us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788620081.530176:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000001:00080000:2.0:1788620081.530268:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:2.0:1788620081.546066:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620081.546171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620081.546970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620081.547089:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120512 00000100:00100000:1.0:1788620081.547105:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120512 00000100:00100000:1.0:1788620081.547200:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120768 00000100:00100000:1.0:1788620081.547205:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120768 00000100:00100000:1.0:1788620081.547239:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788620081.547251:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2357:x1875503657120512:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:1.0:1788620081.547319:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c2d31, atime: 0x6a9c2d30, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788620081.547343:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.547373:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=484s v=(0 0) 00010000:00010000:1.0:1788620081.547379:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620081.547387:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.547405:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.547494:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620081.547521:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+6:2357:x1875503657120768:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:1.0:1788620081.547540:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.547549:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620081.547552:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620081.547556:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.547566:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620081.553964:0:16708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788620081.553986:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788620081.554191:0:16708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121024 00000100:00100000:3.0:1788620081.554204:0:16708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121024 00000100:00100000:2.0:1788620081.554615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620081.554954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620081.555153:0:16708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788620081.555166:0:16708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120640 00000100:00100000:3.0:1788620081.555174:0:16708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120640 00000100:00100000:3.0:1788620081.555213:0:16708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788620081.555219:0:16708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657120896 00000100:00100000:3.0:1788620081.555222:0:16708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657120896 00000100:00100000:3.0:1788620081.555299:0:16710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788620081.555312:0:16710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6eb10b78-2640-4d1c-bba9-c870a1e66de6+9:2357:x1875503657121024:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:3.0:1788620081.555370:0:16710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.555405:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620081.555410:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620081.555419:0:16710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620081.555438:0:16710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620081.630647:0:15169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:1.0:1788620081.630661:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1788620081.630681:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.630696:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.630706:0:15169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.630714:0:15169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620081.630720:0:15169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.630963:0:15169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.630992:0:15169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.631001:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8002fa/0xbb0e330328bbf773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.631143:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+17:2357:x1875503657120768:12345-192.168.203.12@tcp:4:dd.0 Request processed in 83615us (84963us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788620081.631155:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620081.631203:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788620081.631220:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+16:2357:x1875503657120640:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:1.0:1788620081.631261:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.631277:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620081.631283:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620081.631291:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.631307:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620081.632368:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1788620081.632393:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:0.0:1788620081.632840:0:16710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632857:0:16710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632866:0:16710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632889:0:16710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620081.632894:0:16710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632904:0:16710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632923:0:16710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.632931:0:16710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca65e94e/0xbb0e330328bbf77a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.633030:0:16710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:2357:x1875503657121024:12345-192.168.203.12@tcp:4:dd.0 Request processed in 77716us (86252us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788620081.633039:0:16710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788620081.633074:0:16710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620081.633086:0:16710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6eb10b78-2640-4d1c-bba9-c870a1e66de6+11:2357:x1875503657120896:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:0.0:1788620081.633122:0:16710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.633134:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.633139:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620081.633145:0:16710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.633170:0:16710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620081.681182:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788620081.682951:0:15171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788620081.682977:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.682994:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.683005:0:15171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.683014:0:15171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620081.683019:0:15171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.683030:0:15171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.683055:0:15171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.683063:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d216cada/0xbb0e330328bbf76c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.683189:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:2357:x1875503657120512:12345-192.168.203.12@tcp:4:dd.0 Request processed in 135932us (137129us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788620081.683222:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000001:00080000:3.0:1788620081.747291:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:3.0:1788620081.747332:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1788620081.747497:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1788620081.747529:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747544:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747553:0:15169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747560:0:15169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620081.747566:0:15169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747575:0:15169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747598:0:15169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620081.747607:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1424d86/0xbb0e330328bbf781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620081.747727:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+7:2357:x1875503657120640:12345-192.168.203.12@tcp:4:dd.0 Request processed in 116507us (193113us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788620081.747762:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00010000:00010000:0.0:1788620081.752643:0:16710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752670:0:16710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752680:0:16710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752687:0:16710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620081.752693:0:16710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752703:0:16710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752728:0:16710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620081.752735:0:16710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f824d88/0xbb0e330328bbf788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620081.752918:0:16710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2357:x1875503657120896:12345-192.168.203.12@tcp:4:dd.0 Request processed in 119828us (198253us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788620081.752950:0:16710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:0.0:1788620082.311512:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620083.230168:0:16747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788620083.335381:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620084.105012:0:14513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620084.105022:0:14513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620084.105078:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788620084.105086:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788620084.360115:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620084.424944:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620084.424965:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677026432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620084.425031:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620084.425089:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026432 00000100:00100000:2.0:1788620084.425096:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026432 00000100:00100000:2.0:1788620084.425143:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620084.425151:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677026432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620084.425183:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788620084.425220:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677026432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.425227:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788620084.425246:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620084.425270:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788620084.425275:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9333c1eda680, transno 8589934595 00000004:00080000:2.0:1788620084.425285:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788620084.425314:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677026432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620084.426790:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677026560:0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.426846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620084.427204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620084.427212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677026688:0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.427243:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620084.427278:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026560 00000100:00100000:2.0:1788620084.427285:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026560 00000100:00100000:2.0:1788620084.427326:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788620084.427352:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3311:x1875503677026560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.427417:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620084.427427:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503677027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.428692:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620084.428752:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.428808:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620084.428833:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620084.428957:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677026816:0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.428992:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620084.429026:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027072 00000100:00100000:1.0:1788620084.429032:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027072 00000100:00100000:1.0:1788620084.429086:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026944 00000100:00100000:0.0:1788620084.429216:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026816 00000100:00100000:0.0:1788620084.429222:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026816 00000100:00100000:0.0:1788620084.429246:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620084.429254:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503677027072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620084.429309:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875503677027072:12345-0@lo:400:kworker.0 Request processed in 55us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620084.429316:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620084.429343:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620084.429350:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677026816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620084.429383:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677026816:12345-0@lo:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620084.429388:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788620084.429399:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026944 00000100:00100000:1.0:1788620084.429504:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788620084.429512:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.429550:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677026944:12345-0@lo:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620084.429556:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788620084.429669:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677026816:0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.429680:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788620084.430011:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875503677027072:0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.438651:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3311:x1875503677026560:12345-0@lo:400:kworker.0 Request processed in 11308us (11795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.438667:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788620084.438801:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677026688 00000100:00100000:2.0:1788620084.438809:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677026688 00000100:00100000:2.0:1788620084.438856:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620084.438865:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677026688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.438911:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677026688:12345-0@lo:400:kworker.0 Request processed in 48us (11667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.438918:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788620084.438940:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620084.438945:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620084.438975:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677026688:0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.438986:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677026560:0@lo:400:kworker.0 00000100:00100000:2.0:1788620084.439005:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620084.439026:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677027200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620084.439058:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620084.439088:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027200 00000100:00100000:2.0:1788620084.439092:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027200 00000100:00100000:2.0:1788620084.439115:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620084.439121:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677027200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620084.439148:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620084.439184:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677027200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.439190:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620084.439221:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677027200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620084.643418:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620084.643459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620084.643504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620084.643523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620084.643548:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620084.643550:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121152 00000100:00100000:0.0:1788620084.643550:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121408 00000100:00100000:2.0:1788620084.643563:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121152 00000100:00100000:0.0:1788620084.643563:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121408 00000100:00100000:3.0:1788620084.643573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620084.643601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620084.643624:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788620084.643632:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121664 00000100:00100000:0.0:1788620084.643632:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121920 00000100:00100000:0.0:1788620084.643638:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121920 00000100:00100000:2.0:1788620084.643639:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2354:x1875503657121152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620084.643640:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121664 00000100:00100000:0.0:1788620084.643660:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121536 00000100:00100000:0.0:1788620084.643664:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121536 00000100:00100000:3.0:1788620084.643684:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121280 00000100:00100000:3.0:1788620084.643689:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121280 00000100:00100000:0.0:1788620084.643690:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657121792 00000100:00100000:0.0:1788620084.643695:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657121792 00000100:00100000:2.0:1788620084.643714:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2354:x1875503657121152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620084.643724:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788620084.643726:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788620084.643727:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788620084.643739:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657121408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620084.643744:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657121664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620084.643790:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788620084.643800:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657121920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620084.643807:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657121408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620084.643825:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657121664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620084.643837:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788620084.643838:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657121920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620084.643848:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788620084.643857:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788620084.643875:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788620084.643881:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788620084.643891:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+20:2354:x1875503657121280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620084.643897:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657121536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620084.643926:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+20:2354:x1875503657121280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620084.643937:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788620084.643937:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2354:x1875503657121536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.648364:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620084.648389:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657121792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620084.648395:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00080000:0.0:1788620084.648439:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620084.648445:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620084.648447:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620084.648564:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2354:x1875503657121792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 184us (4961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620084.648572:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 Debug log: 29671 lines, 29671 kept, 0 dropped, 0 bad.